Nov 02 09:29:48 devstack cinder-volume[75826]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:29:48 devstack cinder-volume[75826]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:29:48 devstack cinder-volume[75826]: we strongly recommend against using it for new projects. Nov 02 09:29:48 devstack cinder-volume[75826]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:29:48 devstack cinder-volume[75826]: framework. For more detail see Nov 02 09:29:48 devstack cinder-volume[75826]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:29:48 devstack cinder-volume[75826]: import eventlet # noqa Nov 02 09:29:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:29:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:29:50 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:29:51 devstack cinder-volume[75826]: INFO dbcounter [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Registered counter for database cinder Nov 02 09:29:51 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writer thread running {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.rpc [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.rpc [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Determined volume DB was empty at startup. Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG cinder.volume.manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:29:52 devstack cinder-volume[75826]: WARNING stevedore.named [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:29:52 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:29:52 devstack cinder-volume[75826]: WARNING cinder.keymgr.conf_key_mgr [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG cinder.volume.drivers.lvm [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75826) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_concurrency.processutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.378s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.rpc [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.rpc [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 09:29:52 devstack cinder-volume[75826]: WARNING stevedore.named [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:29:52 devstack cinder-volume[75826]: WARNING castellan.key_manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:29:52 devstack cinder-volume[75826]: INFO cinder.volume.manager [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_db.sqlalchemy.engines [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75826) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:29:52 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Starting 1 workers Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Started child 75980 {{(pid=75826) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Full set of CONF: {{(pid=75826) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Configuration options gathered from: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] ================================================================================ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] allow_availability_zone_fallback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] allow_compression_on_image_upload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] allowed_direct_url_schemes = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] api_rate_limit = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] auth_strategy = keystone {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] az_cache_duration = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_host = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75980]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_stats_polling_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backup_api_class = cinder.backup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backup_name_template = backup-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backup_use_same_host = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backup_use_temp_snapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] chap_username = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_internal_tenant_project_id = 46c6e84bb4234c51a477fcbd2ddd06f9 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_internal_tenant_user_id = e45e95f942a140baab8967c69ac73dc6 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cloned_volume_same_az = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cluster = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] compression_format = gzip {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] compute_api_class = cinder.compute.nova.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] config_dir = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] config_source = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] control_exchange = openstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] debug = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] default_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] default_group_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] default_volume_type = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_ssl_cert_verify = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] driver_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] enable_force_upload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] enable_new_services = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] enable_unsupported_driver = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_api_insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_api_ssl_compression = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_ca_certificates_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_catalog_info = image:glance:publicURL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_num_retries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance_request_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] graceful_shutdown_timeout = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] group_api_class = cinder.group.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] host = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_compress_on_upload = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_conversion_address_space_limit = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_conversion_cpu_limit = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_conversion_disable = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_introspection_address_space_limit = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_introspection_cpu_limit = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_volume_cache_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_volume_cache_max_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] init_host_max_objects_retrieval = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] instance_format = [instance: %(uuid)s] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 09:29:52 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iscsi_target_flags = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iscsi_write_cache = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iser_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iser_ip_address = 192.168.122.100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iser_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_color = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_config_append = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_options = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_rotate_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_rotate_interval_type = days {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] log_rotation_type = none {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] max_age = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] max_logfile_count = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] max_logfile_size_mb = 200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] max_over_subscription_ratio = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] message_reap_interval = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] message_ttl = 2592000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] migration_create_volume_timeout_secs = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] monkey_patch = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] monkey_patch_modules = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] my_ip = 192.168.122.100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] no_snapshot_gb_quota = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] num_iser_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] num_shell_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] num_volume_device_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] nvmeof_conn_info_version = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] nvmet_ns_id = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] nvmet_port_id = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_max_limit = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_ext_list = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_listen_port = 8776 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] osapi_volume_workers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] per_volume_size_limit = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] periodic_fuzzy_delay = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] periodic_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] public_endpoint = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] publish_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_backup_gigabytes = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_backups = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_gigabytes = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_groups = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_snapshots = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] quota_volumes = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] rate_limit_burst = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] rate_limit_except_level = CRITICAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] rate_limit_interval = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] reinit_driver_count = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] report_discard_supported = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] report_interval = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] reservation_clean_interval = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] reservation_expire = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] reserved_image_namespaces = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] reserved_percentage = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] rpc_response_timeout = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] run_external_periodic_tasks = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] scst_target_driver = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_down_time = 720 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] shell_completion = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] snapshot_name_template = snapshot-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] snapshot_same_host = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] state_path = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] storage_availability_zone = nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] storage_protocol = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] syslog_log_facility = LOG_USER {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_helper = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_ip_address = 192.168.122.100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:52 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] target_secondary_ip_addresses = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] until_refresh = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_chap_auth = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_default_quota_class = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_journal = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_json = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_stderr = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] use_syslog = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] verify_glance_signatures = enabled {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_api_class = cinder.volume.api.API {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_clear_size = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_copy_bps_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_dd_blocksize = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_name_template = volume-%s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_service_inithost_offload = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volume_usage_audit_period = month {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] zoning_mode = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.auth_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.cache = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.include_service_catalog = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.interface = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:52 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcache_username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.service_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.backend = dogpile.cache.null {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.backend_argument = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.backend_expiration_time = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.config_prefix = cache.oslo {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.debug_cache_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.enable_retry_client = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.enable_socket_keepalive = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.expiration_time = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_dead_retry = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_pool_maxsize = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_sasl_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.proxies = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.redis_db = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.redis_server = localhost:6379 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.retry_delay = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.socket_keepalive_count = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.socket_keepalive_idle = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.socket_keepalive_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.socket_timeout = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.tls_allowed_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.tls_cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.tls_certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.tls_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.tls_keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cache.username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:52 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] coordination.backend_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.asyncio_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.asyncio_slave_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.backend = sqlalchemy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.connection_debug = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.connection_parameters = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.connection_recycle_time = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.connection_trace = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.db_inc_retry_interval = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.db_max_retries = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.db_max_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.db_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.max_overflow = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.max_pool_size = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.max_retries = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.pool_timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.slave_connection = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.sqlite_synchronous = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.synchronous_reader = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] database.use_db_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_tracing.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.connection_string = messaging:// {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.es_doc_type = notification {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.es_scroll_size = 10000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.es_scroll_time = 2m {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.filter_error_trace = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.hmac_keys = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.socket_timeout = 0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.trace_requests = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack sudo[75984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler.trace_sqlalchemy = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler_jaeger.process_tags = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] profiler_otlp.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.policy_default_rule = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack sudo[75984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.policy_file = policy.yaml {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.group = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] privsep_osbrick.user = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.group = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] cinder_sys_admin.user = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.send_service_user_token = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.tls_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] service_user.tls_min_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.auth_type = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.tls_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] glance.tls_min_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.chap_username = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.driver_use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.extra_capabilities = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iscsi_target_flags = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iscsi_write_cache = on {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iser_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iser_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.lvm_share_target = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.lvm_type = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.num_shell_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.report_discard_supported = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.reserved_percentage = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_helper = tgtadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.unique_fqdn_network = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.use_chap_auth = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_backend_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_clear_size = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_reports.file_event_handler = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_reports.log_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.backend_host = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.chap_password = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.chap_username = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.disk_geometry = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_client_cert = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.extra_capabilities = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.filter_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.goodness_function = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iser_helper = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iser_ip_address = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iser_port = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.lvm_share_target = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.lvm_type = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.num_shell_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.replication_device = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.report_discard_supported = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.reserved_percentage = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.scst_target_driver = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.storage_protocol = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_helper = lioadm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_ip_address = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_port = 3260 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.trace_flags = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.use_chap_auth = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_clear = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_clear_size = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] lvmdriver-1.volumes_dir = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_notifications.driver = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] key_manager.fixed_key = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.barbican_api_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.barbican_endpoint = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.barbican_endpoint_type = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.barbican_region_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.number_of_retries = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.retry_delay = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.send_service_user_token = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.tls_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.tls_min_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.verify_ssl = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican.verify_ssl_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.auth_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.tls_ciphers = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] barbican_service_user.tls_min_version = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.approle_role_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.approle_secret_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.auth_method = approle {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.auth_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.kv_mountpoint = secret {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.kv_path = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.kv_version = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.root_token_id = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.timeout = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.token_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.token_role = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.use_ssl = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:29:53 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:29:53 devstack sudo[75984]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:53 devstack sudo[75988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:53 devstack sudo[75988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:53 devstack sudo[75988]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.292s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:29:53 devstack cinder-volume[75980]: INFO cinder.brick.local_dev.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:53 devstack sudo[76015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:53 devstack sudo[76015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:53 devstack sudo[76015]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG cinder.brick.local_dev.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75980) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 09:29:53 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:53 devstack sudo[76149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:53 devstack sudo[76149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:54 devstack sudo[76149]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.504s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:54 devstack sudo[76341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:54 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:54 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:54 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 09:29:54 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:54 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.266s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:54 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:55 devstack sudo[76523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:55 devstack sudo[76523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:55 devstack sudo[76523]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:55 devstack sudo[76602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:55 devstack sudo[76602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:55 devstack sudo[76602]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:55 devstack sudo[76610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:55 devstack sudo[76610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:55 devstack sudo[76610]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:55 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:55 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:55 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:56 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:56 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:56 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:56 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:56 devstack cinder-volume[75980]: INFO cinder.volume.drivers.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:56 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:56 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:56 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:29:56 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:56 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:56 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:57 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:57 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:57 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:57 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:57 devstack sudo[76798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:57 devstack sudo[76798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:57 devstack sudo[76798]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:57 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:57 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:57 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:57 devstack cinder-volume[75980]: INFO cinder.volume.driver [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG cinder.volume.driver [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75980) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_db.sqlalchemy.engines [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75980) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writer thread running {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG cinder.db.api [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Building query based on filter {{(pid=75980) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG cinder.image.image_utils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75980) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:29:57 devstack cinder-volume[75980]: INFO cinder.keymgr.migration [None req-e242e40e-808f-4488-895f-4faf3aadc2a5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:29:57 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:57 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:57 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:58 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:58 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:58 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:58 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:58 devstack sudo[76813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:58 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:58 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:58 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:58 devstack sudo[76816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:58 devstack sudo[76816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:59 devstack sudo[76816]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG cinder.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Notifying Schedulers of capabilities ... {{(pid=75980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:29:59 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Driver initialization completed successfully. Nov 02 09:29:59 devstack cinder-volume[75980]: INFO cinder.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Initiating service 2 cleanup Nov 02 09:29:59 devstack cinder-volume[75980]: INFO cinder.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Service 2 cleanup completed. Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG cinder.service [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Creating RPC server for service cinder-volume {{(pid=75980) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG cinder.service [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75980) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:29:59 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:59 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:29:59 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:59 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:59 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:29:59 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:59 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:29:59 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:29:59 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:29:59 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:29:59 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:30:00 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:30:00 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:30:00 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Nov 02 09:30:00 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:30:00 devstack cinder-volume[75980]: INFO cinder.volume.manager [None req-711eaa8a-2c07-40e5-a5b4-665aa3c023d9 None None] Driver post RPC initialization completed successfully. Nov 02 09:30:02 devstack cinder-volume[75826]: DEBUG dbcounter [-] [75826] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75826) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:30:09 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:30:10 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:30:39 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager._thread_info {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:30:39 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread count: 6 {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:30:39 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread info: [<_MainThread(MainThread, started 134289322479744)>, , , , , ] {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:31:39 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:31:39 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:31:39 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:31:39 devstack sudo[81954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:31:39 devstack sudo[81954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:31:39 devstack sudo[81954]: pam_unix(sudo:session): session closed for user root Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:31:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:31:39 devstack sudo[81957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:31:39 devstack sudo[81957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:31:40 devstack sudo[81957]: pam_unix(sudo:session): session closed for user root Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:31:40 devstack sudo[81960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:31:40 devstack sudo[81960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:31:40 devstack sudo[81960]: pam_unix(sudo:session): session closed for user root Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG cinder.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Notifying Schedulers of capabilities ... {{(pid=75980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager._thread_info {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread count: 6 {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:31:40 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread info: [<_MainThread(MainThread, started 134289322479744)>, , , , , ] {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:32:10 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:SELECT=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:32:10 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:UPDATE=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:32:39 devstack sudo[83689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:32:39 devstack sudo[83689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:32:39 devstack sudo[83689]: pam_unix(sudo:session): session closed for user root Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:32:39 devstack sudo[83713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:32:39 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:32:39 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:32:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:32:39 devstack sudo[83717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:32:39 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:32:40 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root Nov 02 09:32:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:32:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:32:40 devstack sudo[83726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:32:40 devstack sudo[83726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:32:40 devstack sudo[83726]: pam_unix(sudo:session): session closed for user root Nov 02 09:32:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:32:40 devstack cinder-volume[75980]: DEBUG cinder.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Notifying Schedulers of capabilities ... {{(pid=75980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG cinder.volume.drivers.lvm [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Updating volume stats {{(pid=75980) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:33:39 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 09:33:39 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:33:39 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:33:39 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:33:39 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:33:39 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:33:39 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:33:39 devstack sudo[85170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 09:33:39 devstack sudo[85170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:33:40 devstack sudo[85170]: pam_unix(sudo:session): session closed for user root Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:33:40 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 09:33:40 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:33:40 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG oslo_concurrency.processutils [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75980) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG cinder.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Notifying Schedulers of capabilities ... {{(pid=75980) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG oslo_service.periodic_task [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] Running periodic task VolumeManager._thread_info {{(pid=75980) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread count: 6 {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:33:40 devstack cinder-volume[75980]: DEBUG cinder.volume.manager [None req-a0aba98a-d960-449c-8c4e-8dab29c76218 None None] thread info: [<_MainThread(MainThread, started 134289322479744)>, , , , , ] {{(pid=75980) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:34:10 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:SELECT=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:34:10 devstack cinder-volume[75980]: DEBUG dbcounter [-] [75980] Writing DB stats cinder:UPDATE=1 {{(pid=75980) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:34:19 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Caught SIGTERM, stopping children Nov 02 09:34:19 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:19 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:19 devstack cinder-volume[75826]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:19 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Stop services. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:34:19 devstack cinder-volume[75826]: DEBUG oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Killing children. {{(pid=75826) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:34:19 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Waiting on 1 children to exit Nov 02 09:34:24 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Acquiring lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:24 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Acquired lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:24 devstack cinder-volume[75980]: DEBUG oslo_concurrency.lockutils [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Releasing lock "singleton_lock" {{(pid=75980) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:24 devstack cinder-volume[75980]: WARNING amqp [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:34:24 devstack cinder-volume[75980]: WARNING amqp [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:34:24 devstack cinder-volume[75826]: INFO oslo_service.backend._eventlet.service [None req-ae7a5fb1-47f5-4079-b1d9-9aa045f9c9b3 None None] Child 75980 exited with status 0 Nov 02 09:34:24 devstack cinder-volume[86044]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:34:24 devstack cinder-volume[86044]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:34:24 devstack cinder-volume[86044]: we strongly recommend against using it for new projects. Nov 02 09:34:24 devstack cinder-volume[86044]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:34:24 devstack cinder-volume[86044]: framework. For more detail see Nov 02 09:34:24 devstack cinder-volume[86044]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:34:24 devstack cinder-volume[86044]: import eventlet # noqa Nov 02 09:34:26 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:26 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:26 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:27 devstack cinder-volume[86044]: INFO dbcounter [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Registered counter for database cinder Nov 02 09:34:27 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:27 devstack cinder-volume[86044]: DEBUG dbcounter [-] [86044] Writer thread running {{(pid=86044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:34:27 devstack cinder-volume[86044]: INFO cinder.rpc [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:34:27 devstack cinder-volume[86044]: INFO cinder.rpc [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:34:27 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:27 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Determined volume DB was empty at startup. Nov 02 09:34:27 devstack cinder-volume[86044]: DEBUG cinder.volume.manager [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86044) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:34:27 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 09:34:27 devstack cinder-volume[86044]: WARNING stevedore.named [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:34:27 devstack cinder-volume[86044]: WARNING castellan.key_manager [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:34:27 devstack cinder-volume[86044]: WARNING cinder.keymgr.conf_key_mgr [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:34:28 devstack cinder-volume[86044]: INFO cinder.volume.manager [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_db.sqlalchemy.engines [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:28 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Starting 1 workers Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Started child 86267 {{(pid=86044) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Full set of CONF: {{(pid=86044) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] ******************************************************************************** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Configuration options gathered from: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] ================================================================================ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] allow_availability_zone_fallback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] allow_compression_on_image_upload = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] allowed_direct_url_schemes = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] api_rate_limit = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] auth_strategy = keystone {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86267]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_stats_polling_interval = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backup_api_class = cinder.backup.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backup_name_template = backup-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backup_use_same_host = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backup_use_temp_snapshot = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] chap_username = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_internal_tenant_project_id = 46c6e84bb4234c51a477fcbd2ddd06f9 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_internal_tenant_user_id = e45e95f942a140baab8967c69ac73dc6 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cluster = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] compression_format = gzip {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] compute_api_class = cinder.compute.nova.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] config_dir = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] config_source = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] control_exchange = openstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] debug = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] default_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] default_group_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] default_volume_type = QuobyteHD {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_ssl_cert_verify = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] driver_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] enable_new_services = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] enable_unsupported_driver = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] enabled_backends = ['QuobyteHD'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] enforce_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_api_insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_api_ssl_compression = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_ca_certificates_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_catalog_info = image:glance:publicURL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_num_retries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance_request_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] graceful_shutdown_timeout = 5 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] group_api_class = cinder.group.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] host = devstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_compress_on_upload = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_conversion_address_space_limit = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_conversion_cpu_limit = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_conversion_disable = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_introspection_address_space_limit = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.remotefs [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86267) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_introspection_cpu_limit = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_upload_use_cinder_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_upload_use_internal_tenant = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_volume_cache_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_volume_cache_max_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] image_volume_cache_max_size_gb = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] init_host_max_objects_retrieval = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] instance_format = [instance: %(uuid)s] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iscsi_target_flags = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iscsi_write_cache = on {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iser_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iser_ip_address = 192.168.122.100 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iser_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_color = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_config_append = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_options = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_rotate_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_rotate_interval_type = days {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] log_rotation_type = none {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] max_age = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] max_logfile_count = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] max_logfile_size_mb = 200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] max_over_subscription_ratio = 20.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] message_reap_interval = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] message_ttl = 2592000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] migration_create_volume_timeout_secs = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] monkey_patch = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] monkey_patch_modules = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] my_ip = 192.168.122.100 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] no_snapshot_gb_quota = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] num_iser_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] num_shell_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] num_volume_device_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] nvmeof_conn_info_version = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] nvmet_ns_id = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] nvmet_port_id = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_max_limit = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_ext_list = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_listen_port = 8776 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] osapi_volume_workers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] per_volume_size_limit = -1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] periodic_fuzzy_delay = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] periodic_interval = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] public_endpoint = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] publish_errors = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_backup_gigabytes = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_backups = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_gigabytes = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_groups = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_snapshots = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] quota_volumes = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] rate_limit_burst = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] rate_limit_except_level = CRITICAL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] rate_limit_interval = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] reinit_driver_count = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] report_discard_supported = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] report_interval = 120 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] reservation_clean_interval = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] reservation_expire = 86400 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] reserved_image_namespaces = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] reserved_percentage = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] rpc_response_timeout = 120 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] run_external_periodic_tasks = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86267) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:34:28 devstack cinder-volume[86267]: WARNING cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:34:28 devstack cinder-volume[86267]: WARNING cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] scst_target_driver = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_down_time = 720 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] shell_completion = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] snapshot_name_template = snapshot-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Running cmd (subprocess): mount.quobyte {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] state_path = /opt/stack/data/cinder {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] storage_availability_zone = nova {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] storage_protocol = iSCSI {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] syslog_log_facility = LOG_USER {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_helper = lioadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_ip_address = 192.168.122.100 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_protocol = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] target_secondary_ip_addresses = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] transport_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] until_refresh = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_chap_auth = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_default_quota_class = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_journal = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_json = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_stderr = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] use_syslog = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] verify_glance_signatures = enabled {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_api_class = cinder.volume.api.API {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_clear = zero {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_clear_size = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_copy_bps_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_dd_blocksize = 1M {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_name_template = volume-%s {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_service_inithost_offload = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volume_usage_audit_period = month {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] zoning_mode = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_concurrency.disable_process_locking = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.auth_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.include_service_catalog = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.interface = public {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcache_username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.service_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.backend = dogpile.cache.null {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.backend_argument = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.backend_expiration_time = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.config_prefix = cache.oslo {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.debug_cache_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.enable_retry_client = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.enable_socket_keepalive = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.expiration_time = 600 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.hashclient_retry_attempts = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_dead_retry = 300 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_pool_maxsize = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_sasl_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.proxies = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.redis_db = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.redis_server = localhost:6379 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.retry_attempts = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.retry_delay = 0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.socket_keepalive_count = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.socket_keepalive_idle = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.socket_keepalive_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.socket_timeout = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.tls_allowed_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.tls_cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.tls_certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.tls_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.tls_keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cache.username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] coordination.backend_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.asyncio_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.asyncio_slave_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.backend = sqlalchemy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.connection_debug = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.connection_parameters = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.connection_recycle_time = 3600 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.connection_trace = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.db_inc_retry_interval = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.db_max_retries = 20 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.db_max_retry_interval = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.db_retry_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.max_overflow = 50 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.max_pool_size = 5 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.max_retries = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.mysql_wsrep_sync_wait = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.pool_timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.retry_interval = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.slave_connection = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.sqlite_synchronous = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.synchronous_reader = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] database.use_db_reconnect = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_tracing.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.connection_string = messaging:// {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.es_doc_type = notification {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.es_scroll_size = 10000 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.es_scroll_time = 2m {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.filter_error_trace = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.hmac_keys = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.sentinel_service_name = mymaster {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.socket_timeout = 0.1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.trace_requests = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler.trace_sqlalchemy = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler_jaeger.process_tags = {} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler_jaeger.service_name_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] profiler_otlp.service_name_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.enforce_new_defaults = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.policy_default_rule = default {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.policy_file = policy.yaml {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.group = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.helper_command = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] privsep_osbrick.user = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.group = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.helper_command = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] cinder_sys_admin.user = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.send_service_user_token = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86267) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:28 devstack cinder-volume[86267]: INFO cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 ... Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 -c /etc/quobyte/client-cinder.cfg {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] service_user.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.auth_type = password {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] glance.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.chap_username = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.driver_use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.extra_capabilities = {} {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iscsi_target_flags = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iscsi_write_cache = on {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iser_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iser_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_host = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_login = admin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_mount_options = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_private_key = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_share_path = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.num_shell_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.quobyte_volume_url = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.report_discard_supported = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.reserved_percentage = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 -c /etc/quobyte/client-cinder.cfg Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_helper = tgtadm {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_port = 3260 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_protocol = iscsi {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.unique_fqdn_network = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.use_chap_auth = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_backend_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_clear = zero {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_clear_size = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_reports.file_event_handler = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_reports.log_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.backend_availability_zone = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.backend_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.chap_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.chap_username = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.chiscsi_conf = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.disk_geometry = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_client_cert = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_data_namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.driver_use_ssl = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.extra_capabilities = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.filter_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.goodness_function = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iser_helper = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iser_ip_address = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iser_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.iser_target_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_host = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_login = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_mount_options = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_password = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_private_key = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_share_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_ssh_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.num_shell_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.nvmet_port_id = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.replication_device = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.report_discard_supported = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.reserved_percentage = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.scst_target_driver = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.storage_protocol = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_helper = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_ip_address = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_port = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_prefix = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_protocol = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.trace_flags = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.use_chap_auth = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_clear = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_clear_size = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] QuobyteHD.volumes_dir = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_notifications.driver = [] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_notifications.retry = -1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] key_manager.fixed_key = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.barbican_api_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.barbican_endpoint = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.barbican_endpoint_type = public {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.barbican_region_name = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.number_of_retries = 60 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.retry_delay = 1 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.send_service_user_token = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.verify_ssl = True {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican.verify_ssl_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.auth_section = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.auth_type = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.cafile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.certfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.collect_timing = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.insecure = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.keyfile = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.split_loggers = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.timeout = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.tls_ciphers = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] barbican_service_user.tls_min_version = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.approle_role_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.approle_secret_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.auth_method = approle {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.auth_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.kv_mountpoint = secret {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.kv_path = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.kv_version = 2 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.namespace = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.root_token_id = **** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.ssl_ca_crt_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.timeout = 60.0 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.token_file = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.token_role = None {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.use_ssl = False {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:28 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] ******************************************************************************** {{(pid=86044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:34:28 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.484s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:28 devstack cinder-volume[86267]: INFO cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 succeeded Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86267) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.502s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:28 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:28 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:28 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:29 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.256s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.volume.driver [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.volume.driver [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.889347076416, 'free_capacity_gb': 1773.889347076416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86267) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG dbcounter [-] [86267] Writer thread running {{(pid=86267) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.db.api [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Building query based on filter {{(pid=86267) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.image.image_utils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86267) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.keymgr.migration [None req-9a84ab50-b1bc-403e-814b-a5b1af8503f2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86267) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86267) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:29 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:29 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:29 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.251s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Notifying Schedulers of capabilities ... {{(pid=86267) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Driver initialization completed successfully. Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Initiating service 3 cleanup Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Service 3 cleanup completed. Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.service [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Creating RPC server for service cinder-volume {{(pid=86267) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.service [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86267) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:34:29 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86267) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86267) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:29 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:29 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:29 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:29 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.255s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:30 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-f5a867ad-e120-4170-b65e-4b281c7d59ca None None] Driver post RPC initialization completed successfully. Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86267) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG cinder.volume.drivers.quobyte [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86267) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86267) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:35 devstack sudo[86537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:35 devstack sudo[86537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:35 devstack sudo[86537]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG oslo_concurrency.processutils [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.238s {{(pid=86267) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:35 devstack cinder-volume[86267]: DEBUG cinder.manager [None req-34d3b566-f22e-43c2-8787-da847d494997 None None] Notifying Schedulers of capabilities ... {{(pid=86267) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:34:35 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Caught SIGTERM, stopping children Nov 02 09:34:35 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Acquiring lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:35 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Acquired lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:35 devstack cinder-volume[86044]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Releasing lock "singleton_lock" {{(pid=86044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:35 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Stop services. {{(pid=86044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 09:34:35 devstack cinder-volume[86044]: DEBUG oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Killing children. {{(pid=86044) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 09:34:35 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Waiting on 1 children to exit Nov 02 09:34:37 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Acquiring lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:37 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Acquired lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:37 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Releasing lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:37 devstack cinder-volume[86267]: WARNING amqp [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:34:37 devstack cinder-volume[86267]: WARNING amqp [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 09:34:38 devstack cinder-volume[86044]: INFO oslo_service.backend._eventlet.service [None req-64c48e2f-5135-47d9-885b-ba77e3394982 None None] Child 86267 exited with status 0 Nov 02 09:34:38 devstack cinder-volume[86589]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 09:34:38 devstack cinder-volume[86589]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:34:38 devstack cinder-volume[86589]: we strongly recommend against using it for new projects. Nov 02 09:34:38 devstack cinder-volume[86589]: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:34:38 devstack cinder-volume[86589]: framework. For more detail see Nov 02 09:34:38 devstack cinder-volume[86589]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:34:38 devstack cinder-volume[86589]: import eventlet # noqa Nov 02 09:34:42 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 09:34:42 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 09:34:42 devstack cinder-volume[86589]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86589) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 09:34:43 devstack cinder-volume[86589]: INFO dbcounter [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Registered counter for database cinder Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG dbcounter [-] [86589] Writer thread running {{(pid=86589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:34:43 devstack cinder-volume[86589]: INFO cinder.rpc [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 09:34:43 devstack cinder-volume[86589]: INFO cinder.rpc [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:43 devstack cinder-volume[86589]: INFO cinder.volume.manager [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Determined volume DB was empty at startup. Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG cinder.volume.manager [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86589) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 09:34:43 devstack cinder-volume[86589]: WARNING stevedore.named [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 09:34:43 devstack cinder-volume[86589]: WARNING castellan.key_manager [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:34:43 devstack cinder-volume[86589]: WARNING cinder.keymgr.conf_key_mgr [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 09:34:43 devstack cinder-volume[86589]: INFO cinder.volume.manager [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_db.sqlalchemy.engines [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86589) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:43 devstack cinder-volume[86589]: INFO oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Starting 1 workers Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Started child 86887 {{(pid=86589) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Full set of CONF: {{(pid=86589) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] ******************************************************************************** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] Configuration options gathered from: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 09:34:43 devstack cinder-volume[86887]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] ================================================================================ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] allow_availability_zone_fallback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] allow_compression_on_image_upload = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] allowed_direct_url_schemes = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] api_rate_limit = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] auth_strategy = keystone {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_stats_polling_interval = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backup_api_class = cinder.backup.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backup_name_template = backup-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backup_use_same_host = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backup_use_temp_snapshot = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] chap_username = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_internal_tenant_project_id = 46c6e84bb4234c51a477fcbd2ddd06f9 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_internal_tenant_user_id = e45e95f942a140baab8967c69ac73dc6 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cluster = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] compression_format = gzip {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] config_dir = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] config_source = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] control_exchange = openstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] debug = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] default_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] default_group_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] default_volume_type = QuobyteHD {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_ssl_cert_verify = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] driver_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] enable_new_services = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] enable_unsupported_driver = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] enforce_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_api_insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_api_servers = ['http://192.168.122.100/image'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_api_ssl_compression = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_ca_certificates_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_num_retries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance_request_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] graceful_shutdown_timeout = 5 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] group_api_class = cinder.group.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] host = devstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_compress_on_upload = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_conversion_address_space_limit = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_conversion_cpu_limit = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_conversion_disable = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_introspection_address_space_limit = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_introspection_cpu_limit = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_upload_use_cinder_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_upload_use_internal_tenant = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_volume_cache_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_volume_cache_max_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] init_host_max_objects_retrieval = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] instance_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iscsi_target_flags = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iscsi_write_cache = on {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iser_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iser_ip_address = 192.168.122.100 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iser_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_color = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_config_append = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_options = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_rotate_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_rotate_interval_type = days {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] log_rotation_type = none {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] max_age = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] max_logfile_count = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] max_logfile_size_mb = 200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] max_over_subscription_ratio = 20.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] message_reap_interval = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] message_ttl = 2592000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] monkey_patch = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] monkey_patch_modules = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] my_ip = 192.168.122.100 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] no_snapshot_gb_quota = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] num_iser_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] num_shell_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] num_volume_device_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] nvmeof_conn_info_version = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] nvmet_ns_id = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] nvmet_port_id = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_max_limit = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_ext_list = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_listen_port = 8776 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] osapi_volume_workers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] per_volume_size_limit = -1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] periodic_fuzzy_delay = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] periodic_interval = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] public_endpoint = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] publish_errors = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_backup_gigabytes = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_backups = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_gigabytes = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_groups = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86887) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_snapshots = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] quota_volumes = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] rate_limit_burst = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] rate_limit_except_level = CRITICAL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] rate_limit_interval = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] reinit_driver_count = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] report_discard_supported = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] report_interval = 120 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] reservation_clean_interval = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] reservation_expire = 86400 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] reserved_image_namespaces = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] reserved_percentage = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:43 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] rpc_response_timeout = 120 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] run_external_periodic_tasks = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] scst_target_driver = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_down_time = 720 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] shell_completion = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] snapshot_name_template = snapshot-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] state_path = /opt/stack/data/cinder {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] storage_availability_zone = nova {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] storage_protocol = iSCSI {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] syslog_log_facility = LOG_USER {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_helper = lioadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_ip_address = 192.168.122.100 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_protocol = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] target_secondary_ip_addresses = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] transport_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] until_refresh = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_chap_auth = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_default_quota_class = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_journal = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_json = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_stderr = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] use_syslog = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] verify_glance_signatures = enabled {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_api_class = cinder.volume.api.API {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_clear = zero {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_clear_size = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_copy_bps_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_dd_blocksize = 1M {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_name_template = volume-%s {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_service_inithost_offload = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volume_usage_audit_period = month {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] zoning_mode = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.auth_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.interface = public {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcache_username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.service_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.100/identity {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.backend = dogpile.cache.null {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.backend_argument = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.backend_expiration_time = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.config_prefix = cache.oslo {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.debug_cache_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.enable_retry_client = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.enable_socket_keepalive = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.expiration_time = 600 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_dead_retry = 300 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_sasl_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.proxies = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.redis_db = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.redis_server = localhost:6379 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.retry_attempts = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.retry_delay = 0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86887) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 09:34:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.socket_keepalive_count = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.socket_keepalive_idle = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.socket_keepalive_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.socket_timeout = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.tls_allowed_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.tls_cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.tls_certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.tls_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Running cmd (subprocess): mount.quobyte {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.tls_keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cache.username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] coordination.backend_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.asyncio_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.asyncio_slave_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.backend = sqlalchemy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.connection_debug = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.connection_parameters = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.connection_recycle_time = 3600 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.connection_trace = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.db_inc_retry_interval = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.db_max_retries = 20 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.db_max_retry_interval = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.db_retry_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.max_overflow = 50 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.max_pool_size = 5 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.max_retries = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.pool_timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.retry_interval = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.slave_connection = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.sqlite_synchronous = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.synchronous_reader = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] database.use_db_reconnect = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_tracing.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.connection_string = messaging:// {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.es_doc_type = notification {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.es_scroll_size = 10000 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.es_scroll_time = 2m {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.filter_error_trace = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.hmac_keys = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.sentinel_service_name = mymaster {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.socket_timeout = 0.1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.trace_requests = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler.trace_sqlalchemy = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler_jaeger.process_tags = {} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] profiler_otlp.service_name_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.policy_default_rule = default {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.group = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.helper_command = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] privsep_osbrick.user = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.group = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.helper_command = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] cinder_sys_admin.user = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.send_service_user_token = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] service_user.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.auth_type = password {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] glance.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.chap_username = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.driver_use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.extra_capabilities = {} {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iscsi_target_flags = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iser_ip_address = 192.168.122.100 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iser_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_host = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_login = admin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_mount_options = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_private_key = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_share_path = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.report_discard_supported = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_helper = tgtadm {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_ip_address = 192.168.122.100 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_port = 3260 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_protocol = iscsi {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.use_chap_auth = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_backend_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_clear = zero {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_reports.file_event_handler = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_reports.log_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.backend_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.chap_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.chap_username = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.disk_geometry = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_client_cert = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.extra_capabilities = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.filter_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.goodness_function = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iser_helper = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iser_ip_address = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iser_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_host = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_login = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_mount_options = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_password = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_private_key = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_share_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.num_shell_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.replication_device = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.report_discard_supported = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.reserved_percentage = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.scst_target_driver = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.storage_protocol = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_helper = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_ip_address = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_port = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_prefix = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_protocol = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.trace_flags = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.use_chap_auth = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_clear = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_clear_size = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] QuobyteHD.volumes_dir = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack sudo[86899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack sudo[86899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_notifications.driver = [] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] key_manager.fixed_key = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.barbican_api_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.barbican_endpoint = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.barbican_endpoint_type = public {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.barbican_region_name = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.number_of_retries = 60 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.retry_delay = 1 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.send_service_user_token = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.verify_ssl = True {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican.verify_ssl_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.auth_section = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.auth_type = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.cafile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.certfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.collect_timing = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.insecure = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.keyfile = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.split_loggers = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.timeout = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.tls_ciphers = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] barbican_service_user.tls_min_version = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.approle_role_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.approle_secret_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.auth_method = approle {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.auth_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.kv_mountpoint = secret {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.kv_path = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.kv_version = 2 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.namespace = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.root_token_id = **** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.ssl_ca_crt_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.timeout = 60.0 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.token_file = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.token_role = None {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.use_ssl = False {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 09:34:44 devstack cinder-volume[86589]: DEBUG oslo_service.backend._eventlet.service [None req-ec29fdbf-b171-47e7-a0e1-73e7144974e7 None None] ******************************************************************************** {{(pid=86589) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 09:34:44 devstack sudo[86899]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.246s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.volume.driver [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.driver [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.889347076416, 'free_capacity_gb': 1773.889347076416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86887) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_db.sqlalchemy.engines [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86887) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writer thread running {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.db.api [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Building query based on filter {{(pid=86887) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86887) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.keymgr.migration [None req-2e576e71-78c0-4874-b9a9-70979a31bd52 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 09:34:44 devstack sudo[86905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:44 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:44 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.234s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Driver initialization completed successfully. Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Initiating service 3 cleanup Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Service 3 cleanup completed. Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.service [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Creating RPC server for service cinder-volume {{(pid=86887) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.service [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86887) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 09:34:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:34:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:34:44 devstack sudo[86914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:34:44 devstack sudo[86914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:34:45 devstack sudo[86914]: pam_unix(sudo:session): session closed for user root Nov 02 09:34:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.248s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:34:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f5506c65-e53c-4fcf-828e-4d58ab5bfa92 None None] Driver post RPC initialization completed successfully. Nov 02 09:34:53 devstack cinder-volume[86589]: DEBUG dbcounter [-] [86589] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86589) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:34:54 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:34:55 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:34:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:34:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 6 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:34:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:35:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:35:58 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:35:58 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:35:59 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Nov 02 09:35:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 1.014s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:35:59 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:35:59 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:35:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 6 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:35:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Flow 'volume_create_manager' (a9f905ef-30cb-4afa-a3ce-6c8a97e07a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e61aa3-72c6-4925-980b-e54e04a05228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e61aa3-72c6-4925-980b-e54e04a05228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1961909968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b758fa-b933-4b07-a318-75129c113d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369a101aece14ec09b3e6e68ea0df62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:11Z,use_quota=True,user_id='dfc3cacd36304b49badefe3a55e5077d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad015c7a-49be-439f-a243-efd7f783d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad015c7a-49be-439f-a243-efd7f783d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd018160-a1c5-4ea3-80ba-2c90b4721a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd018160-a1c5-4ea3-80ba-2c90b4721a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b758fa-b933-4b07-a318-75129c113d82', 'volume_name': 'volume-76b758fa-b933-4b07-a318-75129c113d82', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae59127e-ce79-4262-8067-28f27ec46ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae59127e-ce79-4262-8067-28f27ec46ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897177ea-fece-4eb4-b933-aec8fe4ed489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Volume 76b758fa-b933-4b07-a318-75129c113d82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b758fa-b933-4b07-a318-75129c113d82', 'volume_size': 1} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1961909968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b758fa-b933-4b07-a318-75129c113d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='369a101aece14ec09b3e6e68ea0df62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:11Z,use_quota=True,user_id='dfc3cacd36304b49badefe3a55e5077d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Creating volume 76b758fa-b933-4b07-a318-75129c113d82 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:36:11 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:36:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:11 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 1073741824 Nov 02 09:36:11 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:13 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 1073741824" returned: 0 in 1.198s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:13 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 Nov 02 09:36:13 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:13 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82" returned: 0 in 0.348s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897177ea-fece-4eb4-b933-aec8fe4ed489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b758fa-b933-4b07-a318-75129c113d82', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffb4190-7a00-42f3-8a07-7374f3fd2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Volume volume-76b758fa-b933-4b07-a318-75129c113d82 (76b758fa-b933-4b07-a318-75129c113d82): created successfully Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffb4190-7a00-42f3-8a07-7374f3fd2b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Flow 'volume_create_manager' (a9f905ef-30cb-4afa-a3ce-6c8a97e07a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-da72a88b-4bbe-4628-8e1b-1266e99cc004 tempest-VolumesAdminNegativeTest-419935212 None] Created volume successfully. Nov 02 09:36:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Acquiring lock "cinder-76b758fa-b933-4b07-a318-75129c113d82-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:36:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "cinder-76b758fa-b933-4b07-a318-75129c113d82-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:36:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Acquiring lock "cinder-quobyte-76b758fa-b933-4b07-a318-75129c113d82" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:36:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "cinder-quobyte-76b758fa-b933-4b07-a318-75129c113d82" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:36:15 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmw7c5o63/privsep.sock'] Nov 02 09:36:15 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmw7c5o63/privsep.sock Nov 02 09:36:15 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 09:36:17 devstack cinder-volume[86887]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 09:36:18 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:18 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Spawned new privsep daemon via rootwrap Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Accepted privsep connection to /tmp/tmpmw7c5o63/privsep.sock {{(pid=86887) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 09:36:18 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 09:36:18 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 09:36:18 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 09:36:18 devstack cinder-volume[86887]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88036 Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[577260ce-75b8-4456-8bea-8e385f177f10]: (2,) {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a26f4f2-5c68-4a52-9095-b69428d58be6]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:18 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 Nov 02 09:36:18 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:18 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82" returned: 0 in 0.562s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:18 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82 Nov 02 09:36:18 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:19 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76b758fa-b933-4b07-a318-75129c113d82" returned: 0 in 0.379s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "cinder-quobyte-76b758fa-b933-4b07-a318-75129c113d82" released by "delete_volume" :: held 3.280s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:36:19 devstack cinder-volume[86887]: WARNING cinder.quota [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:36:19 devstack cinder-volume[86887]: WARNING cinder.quota [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Created reservations ['4208ef26-5aad-4742-affe-557882ae9c9f', '5652b959-5f53-42d7-bb3c-f1d8e6655c7e', '7980ec39-f9eb-46e1-b36a-ad1a98a9187d', '1f906eba-e406-445a-9875-d68ce09fbe9a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:19 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:36:19 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:19 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.500s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:36:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Deleted volume successfully. Nov 02 09:36:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cabf9ba2-f97d-4d96-9371-563f9b943605 tempest-VolumesAdminNegativeTest-419935212 None] Lock "cinder-76b758fa-b933-4b07-a318-75129c113d82-delete_volume" released by "delete_volume" :: held 4.193s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:36:29 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:36:29 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Flow 'volume_create_manager' (ce765502-007e-45e7-a866-ebb456b97027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b98aa06-7762-4c68-a6af-9af982c78827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b98aa06-7762-4c68-a6af-9af982c78827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-752830025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f902fdb-fade-412c-b26a-ef1a83b371a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc37ca58e7e4ed0a623be27eefe0114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:39Z,use_quota=True,user_id='52054888e5e04bd8b0e666b512e0bb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3869eda-c052-4b10-9b10-4e0f5095f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3869eda-c052-4b10-9b10-4e0f5095f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e45660-0860-4c2a-ae32-edd579871c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e45660-0860-4c2a-ae32-edd579871c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f902fdb-fade-412c-b26a-ef1a83b371a5', 'volume_name': 'volume-6f902fdb-fade-412c-b26a-ef1a83b371a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ceb2b3-d9d8-46d7-a94a-dba32f2c9316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ceb2b3-d9d8-46d7-a94a-dba32f2c9316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b7218-e74e-409e-9c62-912a7dd81a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Volume 6f902fdb-fade-412c-b26a-ef1a83b371a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f902fdb-fade-412c-b26a-ef1a83b371a5', 'volume_size': 1} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-752830025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f902fdb-fade-412c-b26a-ef1a83b371a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc37ca58e7e4ed0a623be27eefe0114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:39Z,use_quota=True,user_id='52054888e5e04bd8b0e666b512e0bb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Creating volume 6f902fdb-fade-412c-b26a-ef1a83b371a5 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:36:39 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:36:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:39 devstack sudo[88167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 1073741824 Nov 02 09:36:39 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:40 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 1073741824" returned: 0 in 0.613s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:40 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 Nov 02 09:36:40 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:40 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11b7218-e74e-409e-9c62-912a7dd81a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f902fdb-fade-412c-b26a-ef1a83b371a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce624b95-bc6b-4477-89bf-a8d404dc2e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Volume volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 (6f902fdb-fade-412c-b26a-ef1a83b371a5): created successfully Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce624b95-bc6b-4477-89bf-a8d404dc2e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Flow 'volume_create_manager' (ce765502-007e-45e7-a866-ebb456b97027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1a75f4e3-4413-4688-98a8-edd06baad4d6 tempest-ServerActionsTestOtherA-2147184767 None] Created volume successfully. Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Flow 'volume_create_manager' (535767f1-8955-4c05-9fd5-6f252ce9f818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248cc295-66e3-49a4-a927-5a331d848bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248cc295-66e3-49a4-a927-5a331d848bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1806585211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597a688d-8863-4f75-a649-1c8d482e1208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41ad15e1ed4f2d95cb363cc6985549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:45Z,use_quota=True,user_id='a5589365c1cd405491d0a6b2c9e4c32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9769b91f-2d48-43da-873e-01dee310066b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9769b91f-2d48-43da-873e-01dee310066b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6a8f11-b23f-415c-a463-a0534f57fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6a8f11-b23f-415c-a463-a0534f57fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597a688d-8863-4f75-a649-1c8d482e1208', 'volume_name': 'volume-597a688d-8863-4f75-a649-1c8d482e1208', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf7832e-e5b8-4a7e-86af-bb57ead9d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf7832e-e5b8-4a7e-86af-bb57ead9d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25532d60-6554-478c-80f1-f564bab50785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Volume 597a688d-8863-4f75-a649-1c8d482e1208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597a688d-8863-4f75-a649-1c8d482e1208', 'volume_size': 1} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1806585211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597a688d-8863-4f75-a649-1c8d482e1208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d41ad15e1ed4f2d95cb363cc6985549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:45Z,use_quota=True,user_id='a5589365c1cd405491d0a6b2c9e4c32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Creating volume 597a688d-8863-4f75-a649-1c8d482e1208 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:36:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:45 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 1073741824 Nov 02 09:36:45 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:45 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 1073741824" returned: 0 in 0.688s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:46 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 Nov 02 09:36:46 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:46 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208" returned: 0 in 0.540s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25532d60-6554-478c-80f1-f564bab50785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597a688d-8863-4f75-a649-1c8d482e1208', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab59cb9-32ec-4d3a-89c6-71d17be00bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Volume volume-597a688d-8863-4f75-a649-1c8d482e1208 (597a688d-8863-4f75-a649-1c8d482e1208): created successfully Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab59cb9-32ec-4d3a-89c6-71d17be00bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Flow 'volume_create_manager' (535767f1-8955-4c05-9fd5-6f252ce9f818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-52aab1e1-e261-426a-8def-21415690f440 tempest-AttachVolumeShelveTestJSON-1625868777 None] Created volume successfully. Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Flow 'volume_create_manager' (ff61f23c-9e2f-40d2-8f7e-fd17ccebcd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5437c92e-ad34-45b3-8f7f-9b1dd389d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5437c92e-ad34-45b3-8f7f-9b1dd389d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-984783594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acc88bc-80c3-4a0a-b008-0eb1679c6e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabad8dde1cf4fa09d181abd648b73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:48Z,use_quota=True,user_id='7648ed9a6db14d39af0283ed2f15f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d58b64d-ba2f-46e7-9bf8-6d0b67dabf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d58b64d-ba2f-46e7-9bf8-6d0b67dabf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7352cd3-e404-43fa-9a0c-3e699149d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7352cd3-e404-43fa-9a0c-3e699149d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acc88bc-80c3-4a0a-b008-0eb1679c6e36', 'volume_name': 'volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872f4a1-c052-4c2a-9131-f2ac448b4376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872f4a1-c052-4c2a-9131-f2ac448b4376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42339c55-61f8-4c62-92d2-3495e852e9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Volume 2acc88bc-80c3-4a0a-b008-0eb1679c6e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36', 'volume_size': 1} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-984783594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acc88bc-80c3-4a0a-b008-0eb1679c6e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabad8dde1cf4fa09d181abd648b73f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:36:48Z,use_quota=True,user_id='7648ed9a6db14d39af0283ed2f15f002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:36:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Creating volume 2acc88bc-80c3-4a0a-b008-0eb1679c6e36 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:36:48 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:48 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 1073741824 Nov 02 09:36:48 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:48 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 1073741824" returned: 0 in 0.699s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:48 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 Nov 02 09:36:48 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:49 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" returned: 0 in 0.457s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42339c55-61f8-4c62-92d2-3495e852e9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0182d34e-bc77-4246-9d17-78eab9e06841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:36:49 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Volume volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 (2acc88bc-80c3-4a0a-b008-0eb1679c6e36): created successfully Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0182d34e-bc77-4246-9d17-78eab9e06841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:36:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Flow 'volume_create_manager' (ff61f23c-9e2f-40d2-8f7e-fd17ccebcd33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:36:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-64f2be89-2094-42e9-8695-667f0990ac74 tempest-DeleteServersTestJSON-1539972654 None] Created volume successfully. Nov 02 09:36:56 devstack cinder-volume[86887]: WARNING py.warnings [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 02 09:36:56 devstack cinder-volume[86887]: .first() Nov 02 09:36:56 devstack cinder-volume[86887]: Nov 02 09:36:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '626ecd59-20a3-40d3-87cd-c2870de0a24e', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:36:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-d14e3427-7c83-4112-85ff-abfda0dee7e8 req-690ab8d1-8411-46bc-8f8f-300cf07d733b tempest-DeleteServersTestJSON-1539972654 None] attachment_update completed successfully. Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:36:58 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:36:58 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:36:58 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.573s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:36:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:37:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-7b006b8f-352c-4290-be1e-4764d50b02a5 req-10f71388-7f83-4baf-800d-271ce2061929 tempest-DeleteServersTestJSON-1539972654 None] Terminate volume connection completed successfully. Nov 02 09:37:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-7b006b8f-352c-4290-be1e-4764d50b02a5 req-10f71388-7f83-4baf-800d-271ce2061929 tempest-DeleteServersTestJSON-1539972654 None] Deleting attachment 626ecd59-20a3-40d3-87cd-c2870de0a24e. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:37:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "cinder-2acc88bc-80c3-4a0a-b008-0eb1679c6e36-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "cinder-2acc88bc-80c3-4a0a-b008-0eb1679c6e36-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "cinder-quobyte-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "cinder-quobyte-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbacb2b-8737-4a9d-b867-47e22a327523]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:06 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 Nov 02 09:37:06 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:06 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" returned: 0 in 0.727s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:06 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36 Nov 02 09:37:06 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:07 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" returned: 0 in 0.315s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "cinder-quobyte-2acc88bc-80c3-4a0a-b008-0eb1679c6e36" released by "delete_volume" :: held 1.125s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Created reservations ['b658d111-1097-4d9f-b7df-0a2afd93a899', '1cab890d-001f-4fb6-ae13-e9a30668d9ed', 'ecf9249c-3dc6-4134-8d24-4c6df33956aa', '7b66deed-97c1-493b-9004-b1203bd51dff'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:07 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:37:07 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:07 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.310s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:37:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Deleted volume successfully. Nov 02 09:37:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd37621a-1cbb-45b5-aabd-875b697c92ad tempest-DeleteServersTestJSON-1539972654 None] Lock "cinder-2acc88bc-80c3-4a0a-b008-0eb1679c6e36-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:37:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-24fb65f3-4ff9-4a33-a69a-952ab85852ad req-29b745bd-72f2-46e8-9b0b-ead778b1d21c tempest-AttachVolumeShelveTestJSON-1625868777 None] No connector for attachment 43096b59-ba4f-47c4-95fc-05d6c70c7269; skipping storage backend terminate_connection call. {{(pid=86887) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 09:37:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-24fb65f3-4ff9-4a33-a69a-952ab85852ad req-29b745bd-72f2-46e8-9b0b-ead778b1d21c tempest-AttachVolumeShelveTestJSON-1625868777 None] Deleting attachment 43096b59-ba4f-47c4-95fc-05d6c70c7269. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:37:19 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=20,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:37:19 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=17,cinder:SELECT=20,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Flow 'volume_create_manager' (0344b2ca-c3cc-4451-b974-eca409613b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9386b1-d2f2-4b7a-9e4f-40b94fe223f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9386b1-d2f2-4b7a-9e4f-40b94fe223f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1073133113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd5bfd7-4dfc-429c-ac82-1ab8e9191865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d99f7653a64b258ea917fec94ce86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:37:24Z,use_quota=True,user_id='5193b1402cad45deb56e3cd90f11c317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cf2804-ab09-432a-92f1-72146638c5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cf2804-ab09-432a-92f1-72146638c5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc7d5c5-dedd-439a-90f5-d43f5f129c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc7d5c5-dedd-439a-90f5-d43f5f129c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd5bfd7-4dfc-429c-ac82-1ab8e9191865', 'volume_name': 'volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b403aefb-b4a6-4e4b-a8e3-ec5f19f2681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b403aefb-b4a6-4e4b-a8e3-ec5f19f2681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3b6491-a00b-4dd3-bafc-3434586db487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Volume 9dd5bfd7-4dfc-429c-ac82-1ab8e9191865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865', 'volume_size': 1} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1073133113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd5bfd7-4dfc-429c-ac82-1ab8e9191865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d99f7653a64b258ea917fec94ce86d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:37:24Z,use_quota=True,user_id='5193b1402cad45deb56e3cd90f11c317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Creating volume 9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:37:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:37:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:23 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 1073741824 Nov 02 09:37:23 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:25 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 1073741824" returned: 0 in 1.222s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:25 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 Nov 02 09:37:25 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c1f6d2b5-65bf-4687-93c6-d945557753a0 req-6487fce1-cd16-48bf-bd18-ed03d7ab185c tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:25 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" returned: 0 in 0.325s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c1f6d2b5-65bf-4687-93c6-d945557753a0 req-6487fce1-cd16-48bf-bd18-ed03d7ab185c tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.155s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c1f6d2b5-65bf-4687-93c6-d945557753a0 req-6487fce1-cd16-48bf-bd18-ed03d7ab185c tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3b6491-a00b-4dd3-bafc-3434586db487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806ab61c-5fe6-4828-9a11-9308c71e5860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-c1f6d2b5-65bf-4687-93c6-d945557753a0 req-6487fce1-cd16-48bf-bd18-ed03d7ab185c tempest-ServerActionsTestOtherA-2147184767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-6f902fdb-fade-412c-b26a-ef1a83b371a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b44a4a8c-7ef0-433e-a2e5-26aacb24e1a6', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:37:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Volume volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 (9dd5bfd7-4dfc-429c-ac82-1ab8e9191865): created successfully Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806ab61c-5fe6-4828-9a11-9308c71e5860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:37:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Flow 'volume_create_manager' (0344b2ca-c3cc-4451-b974-eca409613b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:37:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e6f6023c-904d-4d09-b225-d9593f0c0274 tempest-TaggedAttachmentsTest-1740646927 None] Created volume successfully. Nov 02 09:37:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-c1f6d2b5-65bf-4687-93c6-d945557753a0 req-6487fce1-cd16-48bf-bd18-ed03d7ab185c tempest-ServerActionsTestOtherA-2147184767 None] attachment_update completed successfully. Nov 02 09:37:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-ccc3b853-dc90-48ed-b2bf-63c278c2760e tempest-ServerActionsTestOtherA-2147184767 None] Terminate volume connection completed successfully. Nov 02 09:37:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-ccc3b853-dc90-48ed-b2bf-63c278c2760e tempest-ServerActionsTestOtherA-2147184767 None] Deleting attachment b44a4a8c-7ef0-433e-a2e5-26aacb24e1a6. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:37:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-b817e01c-3d39-466b-b794-d02ebff9911e tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-b817e01c-3d39-466b-b794-d02ebff9911e tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-b817e01c-3d39-466b-b794-d02ebff9911e tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-b817e01c-3d39-466b-b794-d02ebff9911e tempest-ServerActionsTestOtherA-2147184767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-6f902fdb-fade-412c-b26a-ef1a83b371a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89447e22-8d4c-405a-a735-9de2dd05217d', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:37:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-dd40e658-fcee-45c3-8c76-6feb79e72adb req-b817e01c-3d39-466b-b794-d02ebff9911e tempest-ServerActionsTestOtherA-2147184767 None] attachment_update completed successfully. Nov 02 09:37:44 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:37:44 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:37:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:37:58 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:37:58 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:37:59 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Nov 02 09:37:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.948s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:37:59 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:37:59 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:37:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 8 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:37:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Flow 'volume_create_manager' (1eddca0b-d6e8-4db5-bc41-66dc8c498ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de79afc5-3b20-48e4-8487-582b734df4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de79afc5-3b20-48e4-8487-582b734df4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-73983472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099a3de6-5fa9-48ac-bbb6-dc1248056cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b61730fd31486a9b2a0b01aa22b25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:06Z,use_quota=True,user_id='b4d1f71350e7471182c769b9a47b8152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9a642-8f8a-4566-befb-cf3bd8491d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e9a642-8f8a-4566-befb-cf3bd8491d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2719f86-7316-4c51-90b3-b2645264f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2719f86-7316-4c51-90b3-b2645264f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '099a3de6-5fa9-48ac-bbb6-dc1248056cbb', 'volume_name': 'volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd52d1ba-611b-4fd1-bd83-bfb4bac8f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd52d1ba-611b-4fd1-bd83-bfb4bac8f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c55a2-fa3a-4fbf-8d35-58be4ab25439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Volume 099a3de6-5fa9-48ac-bbb6-dc1248056cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb', 'volume_size': 1} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-73983472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=099a3de6-5fa9-48ac-bbb6-dc1248056cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b61730fd31486a9b2a0b01aa22b25b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:06Z,use_quota=True,user_id='b4d1f71350e7471182c769b9a47b8152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Creating volume 099a3de6-5fa9-48ac-bbb6-dc1248056cbb {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:05 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:05 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb 1073741824 Nov 02 09:38:05 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Acquiring lock "cinder-597a688d-8863-4f75-a649-1c8d482e1208-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "cinder-597a688d-8863-4f75-a649-1c8d482e1208-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Acquiring lock "cinder-quobyte-597a688d-8863-4f75-a649-1c8d482e1208" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:06 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "cinder-quobyte-597a688d-8863-4f75-a649-1c8d482e1208" acquired by "delete_volume" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb 1073741824" returned: 0 in 0.685s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab0202-9c5c-4972-980c-a77cb2f85d3b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:06 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb Nov 02 09:38:06 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:06 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 Nov 02 09:38:06 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:07 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1c55a2-fa3a-4fbf-8d35-58be4ab25439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e01728f-5e8a-4db1-8470-5a4ca825b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:07 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Volume volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb (099a3de6-5fa9-48ac-bbb6-dc1248056cbb): created successfully Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e01728f-5e8a-4db1-8470-5a4ca825b85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Flow 'volume_create_manager' (1eddca0b-d6e8-4db5-bc41-66dc8c498ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e6053f09-d6a0-4966-aced-4c2b1df1b64c tempest-ServerRescueNegativeTestJSON-1964060886 None] Created volume successfully. Nov 02 09:38:07 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208" returned: 0 in 0.628s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:07 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208 Nov 02 09:38:07 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:07 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-597a688d-8863-4f75-a649-1c8d482e1208" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "cinder-quobyte-597a688d-8863-4f75-a649-1c8d482e1208" released by "delete_volume" :: held 1.098s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Created reservations ['2f7fffe8-a77e-400d-be6c-25f848ec511b', '6ff33172-19c1-48c5-b504-a424905ddc78', '0bf4bc37-c066-4cc2-a1ba-7b884fe42018', 'd2fdd5c5-d4e1-43ce-813c-308663134926'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:08 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:08 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:08 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.491s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Deleted volume successfully. Nov 02 09:38:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-85860d10-4b46-4b43-a418-f1ca801b8560 tempest-AttachVolumeShelveTestJSON-1625868777 None] Lock "cinder-597a688d-8863-4f75-a649-1c8d482e1208-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:38:18 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Acquiring lock "cinder-099a3de6-5fa9-48ac-bbb6-dc1248056cbb-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "cinder-099a3de6-5fa9-48ac-bbb6-dc1248056cbb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Acquiring lock "cinder-quobyte-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "cinder-quobyte-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd7914-4871-45df-979c-27fbc4235730]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:19 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb Nov 02 09:38:19 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:19 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" returned: 0 in 0.590s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:19 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb Nov 02 09:38:19 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:20 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" returned: 0 in 0.409s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "cinder-quobyte-099a3de6-5fa9-48ac-bbb6-dc1248056cbb" released by "delete_volume" :: held 1.134s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Created reservations ['1021d331-d723-434e-8d07-263400aaa273', 'ada86c97-18f2-4699-b3fb-31022d1c63d0', '43475dc1-fcee-4f4d-ba6b-9ee75ea08f1a', '20d63f8d-a13e-40a7-bc9b-39c102153d9f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:20 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:20 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:21 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:21 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Deleted volume successfully. Nov 02 09:38:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ebe9daf-0600-4a77-b9e1-19abc0a50d2d tempest-ServerRescueNegativeTestJSON-1964060886 None] Lock "cinder-099a3de6-5fa9-48ac-bbb6-dc1248056cbb-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-a4e9d001-4471-44e3-a106-8d28eb8d1d0c req-447f3b06-44cf-4322-b0d4-4d00fdd91b58 tempest-ServerActionsTestOtherA-2147184767 None] Terminate volume connection completed successfully. Nov 02 09:38:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-a4e9d001-4471-44e3-a106-8d28eb8d1d0c req-447f3b06-44cf-4322-b0d4-4d00fdd91b58 tempest-ServerActionsTestOtherA-2147184767 None] Deleting attachment 89447e22-8d4c-405a-a735-9de2dd05217d. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (190320a8-f594-4302-85bb-808a97f88b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc5f864-3b88-4715-b086-de5d15683566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc5f864-3b88-4715-b086-de5d15683566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-458616070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df794bcf-939c-4e16-bc5f-c2d98ac434ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:23Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fb69c3-5bc9-4be6-88d2-e976d2866faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96fb69c3-5bc9-4be6-88d2-e976d2866faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fdb69-a5ed-4ec0-a200-cb9cef886c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fdb69-a5ed-4ec0-a200-cb9cef886c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df794bcf-939c-4e16-bc5f-c2d98ac434ea', 'volume_name': 'volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439fa410-4666-4059-bc0a-b1042155bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439fa410-4666-4059-bc0a-b1042155bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2422472-9172-465b-8bb6-5ee40c7cf74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Volume df794bcf-939c-4e16-bc5f-c2d98ac434ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea', 'volume_size': 1} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-458616070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df794bcf-939c-4e16-bc5f-c2d98ac434ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:23Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Creating volume df794bcf-939c-4e16-bc5f-c2d98ac434ea {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:23 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea 1073741824 Nov 02 09:38:23 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:24 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea 1073741824" returned: 0 in 0.859s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:24 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea Nov 02 09:38:24 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:25 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea" returned: 0 in 0.264s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2422472-9172-465b-8bb6-5ee40c7cf74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd16275b-71a9-472e-aac0-cd221c0b23d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Volume volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea (df794bcf-939c-4e16-bc5f-c2d98ac434ea): created successfully Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd16275b-71a9-472e-aac0-cd221c0b23d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (190320a8-f594-4302-85bb-808a97f88b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-44fb0c5a-8b88-44dd-8319-7e5b53fecae6 tempest-VolumesTestJSON-1975094676 None] Created volume successfully. Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (f4ad162e-6659-4308-a741-5739a7e586a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fa9d1a-0a66-4286-b060-be65140ada28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fa9d1a-0a66-4286-b060-be65140ada28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239981229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ddf378-2999-4751-9d4a-0a81d3df44c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:27Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94bf72d-8028-4c1c-8570-ec4b03823d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94bf72d-8028-4c1c-8570-ec4b03823d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57119e61-37b4-4a96-885c-a8d72e4738ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57119e61-37b4-4a96-885c-a8d72e4738ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ddf378-2999-4751-9d4a-0a81d3df44c1', 'volume_name': 'volume-20ddf378-2999-4751-9d4a-0a81d3df44c1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6665adcc-67a3-4939-b0fb-84e7a8b2802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6665adcc-67a3-4939-b0fb-84e7a8b2802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bc01f2-9934-4cd0-98d7-232c5cebbae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:26 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Volume 20ddf378-2999-4751-9d4a-0a81d3df44c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ddf378-2999-4751-9d4a-0a81d3df44c1', 'volume_size': 1} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239981229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ddf378-2999-4751-9d4a-0a81d3df44c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:27Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Creating volume 20ddf378-2999-4751-9d4a-0a81d3df44c1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:26 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:26 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 1073741824 Nov 02 09:38:26 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:27 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 1073741824" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:27 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 Nov 02 09:38:27 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:27 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1" returned: 0 in 0.360s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bc01f2-9934-4cd0-98d7-232c5cebbae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ddf378-2999-4751-9d4a-0a81d3df44c1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cd085c-de0a-4472-82d4-42d1ee328f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:27 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Volume volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 (20ddf378-2999-4751-9d4a-0a81d3df44c1): created successfully Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cd085c-de0a-4472-82d4-42d1ee328f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (f4ad162e-6659-4308-a741-5739a7e586a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d4d67f51-51a1-4570-ac90-f94b97130aa1 tempest-VolumesTestJSON-1975094676 None] Created volume successfully. Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (16043866-f785-41fc-a8c6-1d63f0a9d497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a3d9c6-bbce-4b5f-8d37-573c7d338218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a3d9c6-bbce-4b5f-8d37-573c7d338218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1043092761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:29Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f072142-3d8d-4afd-a440-c8260d7ca93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f072142-3d8d-4afd-a440-c8260d7ca93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cd080f-47c9-4449-b4d0-d1075cf6ed2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5cd080f-47c9-4449-b4d0-d1075cf6ed2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d', 'volume_name': 'volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e27df0-c852-4db4-8bae-dbffda2c549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e27df0-c852-4db4-8bae-dbffda2c549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0801de-4efc-4e59-bb1b-a846821e12a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:29 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Volume ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d', 'volume_size': 1} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1043092761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee4bf35885df443cb47aa83ea3ebfe7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:29Z,use_quota=True,user_id='ea34f72a6cb54be68103dc5e53cc7cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Creating volume ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:29 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:29 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d 1073741824 Nov 02 09:38:29 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:30 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d 1073741824" returned: 0 in 0.512s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:30 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d Nov 02 09:38:30 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:30 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" returned: 0 in 0.281s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0801de-4efc-4e59-bb1b-a846821e12a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f92ae4-5f6b-4754-822e-cf561df072e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:30 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Volume volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d (ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d): created successfully Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f92ae4-5f6b-4754-822e-cf561df072e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Flow 'volume_create_manager' (16043866-f785-41fc-a8c6-1d63f0a9d497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a45ec404-19db-42e3-9f6d-26f636252a81 tempest-VolumesTestJSON-1975094676 None] Created volume successfully. Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Flow 'volume_create_manager' (4388cd2e-e1dd-49f1-aac8-0ea6fda5bdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dcef01-d146-433b-a0f5-0a6fe4de32d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97dcef01-d146-433b-a0f5-0a6fe4de32d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1381339585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24307046-2d06-499f-b2f7-b1d8c694986e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc37ca58e7e4ed0a623be27eefe0114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:31Z,use_quota=True,user_id='52054888e5e04bd8b0e666b512e0bb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad5522-280a-4dbc-a6cf-4c04aaf230c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ad5522-280a-4dbc-a6cf-4c04aaf230c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9925def-62e5-45aa-a19f-73338a1c297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:31 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9925def-62e5-45aa-a19f-73338a1c297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24307046-2d06-499f-b2f7-b1d8c694986e', 'volume_name': 'volume-24307046-2d06-499f-b2f7-b1d8c694986e', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea3d94a-a826-4ed8-a003-7cb09aed1474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ea3d94a-a826-4ed8-a003-7cb09aed1474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d597b037-b5a9-4b11-a525-09ee76404055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:32 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Volume 24307046-2d06-499f-b2f7-b1d8c694986e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24307046-2d06-499f-b2f7-b1d8c694986e', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Trying to clone 24307046-2d06-499f-b2f7-b1d8c694986e from image e2facddb-b106-4022-8544-580b8fc5acbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:38:32 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Image download 20.69 MB at 20.69 MB/s Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c863fe6-61d4-440f-9aa8-42859ced1ce0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:32 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD Nov 02 09:38:32 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "cinder-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-quobyte-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:33 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd is fetched for user 52054888e5e04bd8b0e666b512e0bb2b. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335c0b0-d1b0-4be8-949a-76a22bc4714a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc932a2-9723-4f9e-a881-146e0ceaff5d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:33 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d Nov 02 09:38:33 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:33 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD Nov 02 09:38:33 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:33 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" returned: 0 in 0.540s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:33 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1381339585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24307046-2d06-499f-b2f7-b1d8c694986e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bc37ca58e7e4ed0a623be27eefe0114',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:31Z,use_quota=True,user_id='52054888e5e04bd8b0e666b512e0bb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Creating volume 24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:33 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d Nov 02 09:38:33 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:33 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:33 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1073741824 Nov 02 09:38:33 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:33 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d" released by "delete_volume" :: held 0.955s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Created reservations ['f2dc07dc-7145-4723-8a2f-b2aa781211c8', '7e369b7a-a1a0-428a-9baf-c57da5af4f2b', 'af4d1aaa-4c31-492b-8649-985336d2e577', '108d56f7-8ce3-4284-ad90-decefbc5f2e0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:34 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:34 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:34 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1073741824" returned: 0 in 0.760s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:34 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e Nov 02 09:38:34 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:34 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Deleted volume successfully. Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ce08de23-7c9a-409f-b10f-b0daea41714b tempest-VolumesTestJSON-1975094676 None] Lock "cinder-ef9cfc7f-4d4a-4fb4-ac8a-1557de1a504d-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:34 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e" returned: 0 in 0.321s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Attempting download of e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 24307046-2d06-499f-b2f7-b1d8c694986e. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[898374bc-2970-4425-90ac-bbd1d0e58b3f]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:35 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic Nov 02 09:38:35 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-20ddf378-2999-4751-9d4a-0a81d3df44c1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "cinder-20ddf378-2999-4751-9d4a-0a81d3df44c1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:35 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic" returned: 0 in 0.445s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-quobyte-20ddf378-2999-4751-9d4a-0a81d3df44c1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-20ddf378-2999-4751-9d4a-0a81d3df44c1" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f44a0f-d968-46f3-ba2d-2cc8ceee579d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:35 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic Nov 02 09:38:35 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:35 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 Nov 02 09:38:35 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:35 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic" returned: 1 in 0.528s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_3wl5ltic' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[af65dcbe-7922-439c-b038-b26968f9f7e0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:35 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1" returned: 0 in 0.485s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:35 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1 Nov 02 09:38:35 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:36 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD Nov 02 09:38:36 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:36 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-20ddf378-2999-4751-9d4a-0a81d3df44c1" returned: 0 in 0.330s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-20ddf378-2999-4751-9d4a-0a81d3df44c1" released by "delete_volume" :: held 0.878s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:36 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] e2facddb-b106-4022-8544-580b8fc5acbd was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:36 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e Nov 02 09:38:36 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Created reservations ['df43d6e5-91f9-4322-b9bf-9275416b98dd', '116c1b2a-5c86-4569-b72c-c6a61572e4c8', '213ff5e4-1532-4afb-a03f-9185b558271e', '140d0cf9-14cd-49ad-be94-363193b2eb19'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:36 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:36 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:37 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.527s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:37 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Deleted volume successfully. Nov 02 09:38:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39c490dc-252d-4689-ac15-e155325fdeba tempest-VolumesTestJSON-1975094676 None] Lock "cinder-20ddf378-2999-4751-9d4a-0a81d3df44c1-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-df794bcf-939c-4e16-bc5f-c2d98ac434ea-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "cinder-df794bcf-939c-4e16-bc5f-c2d98ac434ea-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "cinder-quobyte-df794bcf-939c-4e16-bc5f-c2d98ac434ea" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-df794bcf-939c-4e16-bc5f-c2d98ac434ea" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[93362d27-6009-4e74-86f6-d243f0212237]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:38 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea Nov 02 09:38:38 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:38 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea" returned: 0 in 0.599s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:38 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea Nov 02 09:38:38 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c38b010f-8aee-4271-8cf3-507309d55d72 req-95c3ac73-761b-4a6c-993b-a67dde789a8e tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c38b010f-8aee-4271-8cf3-507309d55d72 req-95c3ac73-761b-4a6c-993b-a67dde789a8e tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-c38b010f-8aee-4271-8cf3-507309d55d72 req-95c3ac73-761b-4a6c-993b-a67dde789a8e tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-c38b010f-8aee-4271-8cf3-507309d55d72 req-95c3ac73-761b-4a6c-993b-a67dde789a8e tempest-TaggedAttachmentsTest-1740646927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad0cba13-930d-4476-b958-abac620b21c4', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:38:39 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-c38b010f-8aee-4271-8cf3-507309d55d72 req-95c3ac73-761b-4a6c-993b-a67dde789a8e tempest-TaggedAttachmentsTest-1740646927 None] attachment_update completed successfully. Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:39 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Flow 'volume_create_manager' (e1ad1b94-078d-409a-bc57-63f7427fd1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c19f2b5-fe8d-4505-802b-17acb7ad8c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-df794bcf-939c-4e16-bc5f-c2d98ac434ea" returned: 0 in 0.367s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "cinder-quobyte-df794bcf-939c-4e16-bc5f-c2d98ac434ea" released by "delete_volume" :: held 1.059s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c19f2b5-fe8d-4505-802b-17acb7ad8c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-960273301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fd4df7-e719-42a5-9ae6-cb3de7c98030,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b7f025631454f1ba6bf5209bb5189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:39Z,use_quota=True,user_id='9a5faed2a48c4c75ba7b3aca12c0b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2bdc33-949a-4fba-a20f-b0cd813b56ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2bdc33-949a-4fba-a20f-b0cd813b56ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9352aca-eb9a-48c8-8fce-b8e31e898f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9352aca-eb9a-48c8-8fce-b8e31e898f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5fd4df7-e719-42a5-9ae6-cb3de7c98030', 'volume_name': 'volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b498170-51f0-45f7-a4b9-c94bc4fd934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b498170-51f0-45f7-a4b9-c94bc4fd934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06665432-488f-40e7-b69b-b2807e545bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Volume f5fd4df7-e719-42a5-9ae6-cb3de7c98030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030', 'volume_size': 1} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-960273301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fd4df7-e719-42a5-9ae6-cb3de7c98030,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5b7f025631454f1ba6bf5209bb5189c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:39Z,use_quota=True,user_id='9a5faed2a48c4c75ba7b3aca12c0b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Creating volume f5fd4df7-e719-42a5-9ae6-cb3de7c98030 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:39 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:39 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 1073741824 Nov 02 09:38:39 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Created reservations ['6c06120d-5ca8-40d3-a862-043052a7bf34', '68e33fc7-09ae-4a6f-bd1d-8aaf5a1ac209', '2cbead37-18c9-4dbd-a4b2-60d6a33c6f20', 'e51cae57-4149-4ab8-8f38-81da3aa06427'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:39 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e" returned: 0 in 3.155s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_4k9c8pjcdevstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:38:39 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Converted 112.00 MB image at 35.47 MB/s Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:39 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:39 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:39 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1G Nov 02 09:38:39 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:39 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.342s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:39 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Deleted volume successfully. Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a0d99fc5-500a-4197-b1e5-b27bb3433df9 tempest-VolumesTestJSON-1975094676 None] Lock "cinder-df794bcf-939c-4e16-bc5f-c2d98ac434ea-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:39 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 1073741824" returned: 0 in 0.651s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:39 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e 1G" returned: 0 in 0.452s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Downloaded image e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 24307046-2d06-499f-b2f7-b1d8c694986e successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd for user 52054888e5e04bd8b0e666b512e0bb2b is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Marking volume 24307046-2d06-499f-b2f7-b1d8c694986e as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Copying metadata from image e2facddb-b106-4022-8544-580b8fc5acbd to 24307046-2d06-499f-b2f7-b1d8c694986e. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Creating volume glance metadata for volume 24307046-2d06-499f-b2f7-b1d8c694986e backed by image e2facddb-b106-4022-8544-580b8fc5acbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:38:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:39 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 Nov 02 09:38:39 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d597b037-b5a9-4b11-a525-09ee76404055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24307046-2d06-499f-b2f7-b1d8c694986e', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ed82fc-48e4-4b57-abfd-dd8143eceec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Volume volume-24307046-2d06-499f-b2f7-b1d8c694986e (24307046-2d06-499f-b2f7-b1d8c694986e): created successfully Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ed82fc-48e4-4b57-abfd-dd8143eceec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Flow 'volume_create_manager' (4388cd2e-e1dd-49f1-aac8-0ea6fda5bdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-13e3389b-d27b-4502-a466-9c435635dcae tempest-ServerActionsTestOtherA-2147184767 None] Created volume successfully. Nov 02 09:38:40 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" returned: 0 in 0.305s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06665432-488f-40e7-b69b-b2807e545bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b122aacd-d6d8-4010-8618-31ca1b4ce673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Volume volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 (f5fd4df7-e719-42a5-9ae6-cb3de7c98030): created successfully Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b122aacd-d6d8-4010-8618-31ca1b4ce673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Flow 'volume_create_manager' (e1ad1b94-078d-409a-bc57-63f7427fd1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-0605d4c4-d55f-4f03-84a2-1b2c032b2060 req-02e3461e-fbdf-49c6-bba2-8da874587e6c tempest-VolumesGetTestJSON-1106016655 None] Created volume successfully. Nov 02 09:38:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Acquiring lock "cinder-f5fd4df7-e719-42a5-9ae6-cb3de7c98030-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "cinder-f5fd4df7-e719-42a5-9ae6-cb3de7c98030-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Acquiring lock "cinder-quobyte-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "cinder-quobyte-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84839e5-6c44-4702-90d9-6cb71e9285d5]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:42 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 Nov 02 09:38:42 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:42 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-fbf431d5-da14-466a-bdba-0d8eae5a7bea req-b65e3a5c-969c-4c24-ac62-a2e214a01735 tempest-TaggedAttachmentsTest-1740646927 None] Terminate volume connection completed successfully. Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-fbf431d5-da14-466a-bdba-0d8eae5a7bea req-b65e3a5c-969c-4c24-ac62-a2e214a01735 tempest-TaggedAttachmentsTest-1740646927 None] Deleting attachment ad0cba13-930d-4476-b958-abac620b21c4. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:38:42 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" returned: 0 in 0.574s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:42 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030 Nov 02 09:38:42 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:42 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "cinder-quobyte-f5fd4df7-e719-42a5-9ae6-cb3de7c98030" released by "delete_volume" :: held 0.975s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.quota [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Created reservations ['50f71e4b-a190-4c6c-820f-eb490911e010', '3197b828-7601-4e5c-9dda-3e8af03400f4', 'a19dab38-d40a-4b71-9052-750551ecb7c7', '2abffb31-ba2e-4366-a9ab-e30331d8844a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:43 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:43 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.479s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.manager [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:43 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Deleted volume successfully. Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-56ad6884-7150-40ce-91ad-abb7fddb0ef1 req-ec8eceb1-8167-4791-b5dd-92166b11b01e tempest-VolumesGetTestJSON-1106016655 None] Lock "cinder-f5fd4df7-e719-42a5-9ae6-cb3de7c98030-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-494b452c-573c-483b-91b0-04068ab06088 req-8894abb0-ba7f-450d-abb6-c1d32b53fa12 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-494b452c-573c-483b-91b0-04068ab06088 req-8894abb0-ba7f-450d-abb6-c1d32b53fa12 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-494b452c-573c-483b-91b0-04068ab06088 req-8894abb0-ba7f-450d-abb6-c1d32b53fa12 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-494b452c-573c-483b-91b0-04068ab06088 req-8894abb0-ba7f-450d-abb6-c1d32b53fa12 tempest-ServerActionsTestOtherA-2147184767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-24307046-2d06-499f-b2f7-b1d8c694986e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f212c9a6-e6ed-4ec2-94a2-09ee0f3e7375', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:38:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-494b452c-573c-483b-91b0-04068ab06088 req-8894abb0-ba7f-450d-abb6-c1d32b53fa12 tempest-ServerActionsTestOtherA-2147184767 None] attachment_update completed successfully. Nov 02 09:38:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e159ab07-e2c8-4eb3-a56b-062a22ae0cc5 tempest-BackendsCapabilitiesAdminTestsJSON-382952312 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.889347076416, 'free_capacity_gb': 1773.889347076416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86887) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 09:38:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-530644d1-9bda-4401-97f7-b96b54fec364 tempest-BackendsCapabilitiesAdminTestsJSON-382952312 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.889347076416, 'free_capacity_gb': 1773.889347076416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86887) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 09:38:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-db28b57b-0834-49d7-8dad-5aea0ac11a55 tempest-GroupsTest-667909122 None] Group tempest-Group1-1912220676: creating Nov 02 09:38:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-db28b57b-0834-49d7-8dad-5aea0ac11a55 tempest-GroupsTest-667909122 None] Group tempest-Group1-1912220676: created successfully Nov 02 09:38:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-db28b57b-0834-49d7-8dad-5aea0ac11a55 tempest-GroupsTest-667909122 None] Create group completed successfully. Nov 02 09:38:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ed80bd9c-9e9f-4aa1-8428-d87f66c8f9cd tempest-GroupsTest-667909122 None] Group tempest-Group2-2093252966: creating Nov 02 09:38:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ed80bd9c-9e9f-4aa1-8428-d87f66c8f9cd tempest-GroupsTest-667909122 None] Group tempest-Group2-2093252966: created successfully Nov 02 09:38:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ed80bd9c-9e9f-4aa1-8428-d87f66c8f9cd tempest-GroupsTest-667909122 None] Create group completed successfully. Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (cd2f7222-5266-4272-89ab-6bd41f3ac05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0b5579-0ed6-4ea4-8868-7af0580252ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0b5579-0ed6-4ea4-8868-7af0580252ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407619359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=971a5dec-db24-4390-a2a6-7ba6027e3961,host='devstack@QuobyteHD#QuobyteHD',id=f5817788-5cd2-4211-9228-f4a6d0f679a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:57Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe7aad35-bac9-4db0-978a-9d9dd13d3d1e),volume_type_id=fe7aad35-bac9-4db0-978a-9d9dd13d3d1e)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb961405-0c95-4e84-b414-81a8e6ef96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb961405-0c95-4e84-b414-81a8e6ef96cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfddf68b-dc3b-4162-866b-2487988976c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfddf68b-dc3b-4162-866b-2487988976c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5817788-5cd2-4211-9228-f4a6d0f679a5', 'volume_name': 'volume-f5817788-5cd2-4211-9228-f4a6d0f679a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96782c12-5b18-4e56-ba44-efb94ed2b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96782c12-5b18-4e56-ba44-efb94ed2b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12473d1-2b09-4534-9472-23bca5d0c0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Volume f5817788-5cd2-4211-9228-f4a6d0f679a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5817788-5cd2-4211-9228-f4a6d0f679a5', 'volume_size': 1} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=971a5dec-db24-4390-a2a6-7ba6027e3961,created_at=2026-11-02T08:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1407619359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=971a5dec-db24-4390-a2a6-7ba6027e3961,host='devstack@QuobyteHD#QuobyteHD',id=f5817788-5cd2-4211-9228-f4a6d0f679a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:38:57Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe7aad35-bac9-4db0-978a-9d9dd13d3d1e),volume_type_id=fe7aad35-bac9-4db0-978a-9d9dd13d3d1e)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Creating volume f5817788-5cd2-4211-9228-f4a6d0f679a5 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:38:57 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:38:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:57 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 1073741824 Nov 02 09:38:57 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:58 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:38:58 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:58 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 1073741824" returned: 0 in 1.148s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:58 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.683s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:38:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:58 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 Nov 02 09:38:58 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "cinder-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "cinder-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "cinder-quobyte-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "cinder-quobyte-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:38:59 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5" returned: 0 in 0.600s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1bc1a0-887d-4cfd-b047-b792c8b6ef04]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12473d1-2b09-4534-9472-23bca5d0c0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5817788-5cd2-4211-9228-f4a6d0f679a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b142ec0e-21af-47b8-bcf9-395c0f3a132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:38:59 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Volume volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 (f5817788-5cd2-4211-9228-f4a6d0f679a5): created successfully Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b142ec0e-21af-47b8-bcf9-395c0f3a132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:38:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (cd2f7222-5266-4272-89ab-6bd41f3ac05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:38:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b7c4d8c8-bc0a-40c2-bb74-a07adfbda234 tempest-GroupsTest-667909122 None] Created volume successfully. Nov 02 09:38:59 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 Nov 02 09:38:59 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6876728b-65d5-4aa8-b9e0-5a12abbfa5b7 tempest-GroupSnapshotsV319Test-1947743936 None] Group tempest-GroupSnapshotsV319Test-Group-249914397: creating Nov 02 09:39:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6876728b-65d5-4aa8-b9e0-5a12abbfa5b7 tempest-GroupSnapshotsV319Test-1947743936 None] Group tempest-GroupSnapshotsV319Test-Group-249914397: created successfully Nov 02 09:39:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6876728b-65d5-4aa8-b9e0-5a12abbfa5b7 tempest-GroupSnapshotsV319Test-1947743936 None] Create group completed successfully. Nov 02 09:39:00 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" returned: 0 in 0.720s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:00 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865 Nov 02 09:39:00 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:00 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" returned: 0 in 0.379s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "cinder-quobyte-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865" released by "delete_volume" :: held 1.164s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Created reservations ['66f2d47e-e867-4622-a83c-ab10084674e7', '877738e6-e709-4134-a3a2-4932bb4fcbdd', '53d9070b-4c99-479d-b2c4-94f43ec98c0f', 'f38ba840-9fc1-4b74-a7d6-bd6471c06054'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:00 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:00 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Acquiring lock "cinder-quobyte-f5817788-5cd2-4211-9228-f4a6d0f679a5" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-f5817788-5cd2-4211-9228-f4a6d0f679a5" acquired by "delete_volume" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:01 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.417s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Deleted volume successfully. Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a7e38f-dbcb-4382-8a5a-03fb22b92eb2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c08556cc-79ff-47db-9237-a0f0b8932113 tempest-TaggedAttachmentsTest-1740646927 None] Lock "cinder-9dd5bfd7-4dfc-429c-ac82-1ab8e9191865-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:01 devstack sudo[92094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 Nov 02 09:39:01 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:02 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5" returned: 0 in 0.908s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:02 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5 Nov 02 09:39:02 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Flow 'volume_create_manager' (82621249-09a5-48ec-a70d-a8b953d480df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda5ed0-fab3-4a84-bbdf-05dd711b0265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acda5ed0-fab3-4a84-bbdf-05dd711b0265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-475407050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd2474e2-375f-48e0-b89a-b1e8b52bdc67,host='devstack@QuobyteHD#QuobyteHD',id=a920292d-9053-4861-81a6-ac4ce05ca3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd79028928a749fbb7cc71c8858fc051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:02Z,use_quota=True,user_id='6e0b62eb3c11460d8574cda4ed7d96e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39b173c8-c528-483a-ab11-ac6bb2529554),volume_type_id=39b173c8-c528-483a-ab11-ac6bb2529554)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436bcc08-9a69-4307-ab60-b5fe0f942d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436bcc08-9a69-4307-ab60-b5fe0f942d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3253110c-60d5-4280-b849-2e4af68159d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3253110c-60d5-4280-b849-2e4af68159d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a920292d-9053-4861-81a6-ac4ce05ca3b6', 'volume_name': 'volume-a920292d-9053-4861-81a6-ac4ce05ca3b6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffac66ad-e61b-44f5-a333-697e12db2cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffac66ad-e61b-44f5-a333-697e12db2cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caddf8e3-40c1-461b-95e4-19a3fdf5cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Volume a920292d-9053-4861-81a6-ac4ce05ca3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a920292d-9053-4861-81a6-ac4ce05ca3b6', 'volume_size': 1} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd2474e2-375f-48e0-b89a-b1e8b52bdc67,created_at=2026-11-02T08:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-475407050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd2474e2-375f-48e0-b89a-b1e8b52bdc67,host='devstack@QuobyteHD#QuobyteHD',id=a920292d-9053-4861-81a6-ac4ce05ca3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd79028928a749fbb7cc71c8858fc051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:02Z,use_quota=True,user_id='6e0b62eb3c11460d8574cda4ed7d96e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39b173c8-c528-483a-ab11-ac6bb2529554),volume_type_id=39b173c8-c528-483a-ab11-ac6bb2529554)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Creating volume a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:39:02 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:02 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 1073741824 Nov 02 09:39:02 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:02 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5817788-5cd2-4211-9228-f4a6d0f679a5" returned: 0 in 0.501s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-f5817788-5cd2-4211-9228-f4a6d0f679a5" released by "delete_volume" :: held 1.508s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:02 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Created reservations ['cb2a1db2-2157-4af2-b2ad-35fc1dc0fd62'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:03 devstack cinder-volume[86887]: WARNING cinder.quota [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1013444423 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1013444423, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:03 devstack cinder-volume[86887]: WARNING cinder.quota [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1013444423 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1013444423, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Created reservations ['28709bdb-d44b-4e61-939d-09cbb4b65d59', '74a3a4c0-3c30-459c-b2eb-a8637c8f7623', '21658d36-b14d-40d5-a6be-7eb9a5d0b10e', '69db87f0-8a2a-4aaf-b8a4-9e14099337e1'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:03 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:03 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:03 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 1073741824" returned: 0 in 0.881s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:03 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 Nov 02 09:39:03 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:03 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.450s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fc2f0b78-f04f-4a54-949f-58a132df6a2d tempest-GroupsTest-667909122 None] Delete group completed successfully. Nov 02 09:39:03 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caddf8e3-40c1-461b-95e4-19a3fdf5cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a920292d-9053-4861-81a6-ac4ce05ca3b6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e88ad4f-9e03-4084-a52d-ed3f4ca4b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:03 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Volume volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 (a920292d-9053-4861-81a6-ac4ce05ca3b6): created successfully Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e88ad4f-9e03-4084-a52d-ed3f4ca4b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Flow 'volume_create_manager' (82621249-09a5-48ec-a70d-a8b953d480df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-327cea40-8c01-4d44-b7f7-aa7f06c080e0 tempest-GroupSnapshotsV319Test-1947743936 None] Created volume successfully. Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Created reservations ['07eb60a5-0c41-464b-9534-9f0a3e9af6c3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:04 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:04 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:04 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-70c5944f-d478-477d-96ad-b0bfb5e17d3b tempest-GroupsTest-667909122 None] Delete group completed successfully. Nov 02 09:39:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-2552107b-23e7-4cba-bab1-4a263e2a77f7 tempest-ServerActionsTestOtherA-2147184767 None] Terminate volume connection completed successfully. Nov 02 09:39:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-2552107b-23e7-4cba-bab1-4a263e2a77f7 tempest-ServerActionsTestOtherA-2147184767 None] Deleting attachment f212c9a6-e6ed-4ec2-94a2-09ee0f3e7375. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:39:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] GroupSnapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: creating. Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Group snapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: creating. {{(pid=86887) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Creating offline snapshot 771e4604-6e1d-48c4-8f5a-c20a6b34583b of volume a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[da372b32-65d2-4af7-b5c9-01b6ce9a5dfa]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:06 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 Nov 02 09:39:06 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9fc82b36-563d-4eec-b8c6-18bc73ee4122 tempest-GroupsTest-667909122 None] Group tempest-GroupsTest-Group-407812038: creating Nov 02 09:39:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9fc82b36-563d-4eec-b8c6-18bc73ee4122 tempest-GroupsTest-667909122 None] Group tempest-GroupsTest-Group-407812038: created successfully Nov 02 09:39:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9fc82b36-563d-4eec-b8c6-18bc73ee4122 tempest-GroupsTest-667909122 None] Create group completed successfully. Nov 02 09:39:06 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6" returned: 0 in 0.524s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:06 devstack sudo[92176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b 1G Nov 02 09:39:06 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:06 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b 1G" returned: 0 in 0.481s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:06 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b Nov 02 09:39:06 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-7021f781-fd56-4ae4-b264-f3a269ed1326 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:07 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:07 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:07 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b Nov 02 09:39:07 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:07 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b" returned: 0 in 0.257s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:07 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info Nov 02 09:39:07 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:07 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info" returned: 0 in 0.296s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:07 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:39:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:07 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info Nov 02 09:39:07 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (fb6b8d27-c4de-4474-9b29-47e150aa1e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd41b9a-b9e3-47f6-a888-8ba4accc8cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd41b9a-b9e3-47f6-a888-8ba4accc8cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844469501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f78917b5-a16f-4837-ab3a-024ad512ee05,host='devstack@QuobyteHD#QuobyteHD',id=9315cd35-d851-4ff0-a2d4-2444aa224f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:08Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65f71a94-ffe5-4e4f-a048-e3c06694c705),volume_type_id=65f71a94-ffe5-4e4f-a048-e3c06694c705)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:08 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8fc889-0d30-45b3-aaae-3fb52daf6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8fc889-0d30-45b3-aaae-3fb52daf6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dcc297-1206-421e-80f1-39829caea9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dcc297-1206-421e-80f1-39829caea9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9315cd35-d851-4ff0-a2d4-2444aa224f2a', 'volume_name': 'volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca5fa0-29c1-4bc2-a378-05de2049dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ca5fa0-29c1-4bc2-a378-05de2049dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc8756d-b304-4e53-a3e1-8318df1679f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Volume 9315cd35-d851-4ff0-a2d4-2444aa224f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a', 'volume_size': 1} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.info" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-7021f781-fd56-4ae4-b264-f3a269ed1326 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.293s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-7021f781-fd56-4ae4-b264-f3a269ed1326 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f78917b5-a16f-4837-ab3a-024ad512ee05,created_at=2026-11-02T08:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1844469501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f78917b5-a16f-4837-ab3a-024ad512ee05,host='devstack@QuobyteHD#QuobyteHD',id=9315cd35-d851-4ff0-a2d4-2444aa224f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:08Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65f71a94-ffe5-4e4f-a048-e3c06694c705),volume_type_id=65f71a94-ffe5-4e4f-a048-e3c06694c705)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Creating volume 9315cd35-d851-4ff0-a2d4-2444aa224f2a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:39:08 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:08 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a 1073741824 Nov 02 09:39:08 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-7021f781-fd56-4ae4-b264-f3a269ed1326 tempest-ServerActionsTestOtherA-2147184767 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-24307046-2d06-499f-b2f7-b1d8c694986e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee73aa66-22a9-4cad-b7ba-7036465407f5', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:39:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-be477390-89b0-4e50-bf54-6c0396e8821e tempest-GroupSnapshotsV319Test-1947743936 None] group_snapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: created successfully Nov 02 09:39:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-a4d5cd9a-95c0-4cbb-aaea-7f61c6a71191 req-7021f781-fd56-4ae4-b264-f3a269ed1326 tempest-ServerActionsTestOtherA-2147184767 None] attachment_update completed successfully. Nov 02 09:39:08 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a 1073741824" returned: 0 in 0.520s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:08 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a Nov 02 09:39:08 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:09 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a" returned: 0 in 0.507s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc8756d-b304-4e53-a3e1-8318df1679f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fb9a5b-45ca-492f-a3f5-8e402524782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:09 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Volume volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a (9315cd35-d851-4ff0-a2d4-2444aa224f2a): created successfully Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fb9a5b-45ca-492f-a3f5-8e402524782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (fb6b8d27-c4de-4474-9b29-47e150aa1e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e75d3f90-a216-45bb-b29a-43a7f9a682be tempest-GroupsTest-667909122 None] Created volume successfully. Nov 02 09:39:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] group_snapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: deleting Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] group_snapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: deleting {{(pid=86887) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "cinder-quobyte-771e4604-6e1d-48c4-8f5a-c20a6b34583b" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-771e4604-6e1d-48c4-8f5a-c20a6b34583b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Deleting offline snapshot 771e4604-6e1d-48c4-8f5a-c20a6b34583b of volume a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] snapshot_file for this snap is: volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd17350-f5d5-4a36-b063-da30fefc1977]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:10 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b Nov 02 09:39:10 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:10 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b" returned: 0 in 0.595s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a920292d-9053-4861-81a6-ac4ce05ca3b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4969713c-e992-4c8b-ac78-c31dc09d4328]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:11 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 Nov 02 09:39:11 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:11 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6" returned: 0 in 0.734s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:39:11 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b Nov 02 09:39:11 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (f84bf49d-d918-415e-84ca-92db98b0c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85947f19-6bf1-42cc-a828-a4501445d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85947f19-6bf1-42cc-a828-a4501445d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1293764527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f78917b5-a16f-4837-ab3a-024ad512ee05,host='devstack@QuobyteHD#QuobyteHD',id=33a7a361-101b-406a-bc88-43572ad71da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:12Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65f71a94-ffe5-4e4f-a048-e3c06694c705),volume_type_id=65f71a94-ffe5-4e4f-a048-e3c06694c705)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f002e5-ea23-428a-bc1a-c5a76c5f9d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f002e5-ea23-428a-bc1a-c5a76c5f9d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba3b5a1-3559-45b7-acf7-7047f95e7bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba3b5a1-3559-45b7-acf7-7047f95e7bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a7a361-101b-406a-bc88-43572ad71da6', 'volume_name': 'volume-33a7a361-101b-406a-bc88-43572ad71da6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd0deba-e458-4d5e-9afc-315104c288f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd0deba-e458-4d5e-9afc-315104c288f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef4f17c-337b-4131-b8ba-5f561c68fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Volume 33a7a361-101b-406a-bc88-43572ad71da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a7a361-101b-406a-bc88-43572ad71da6', 'volume_size': 1} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f78917b5-a16f-4837-ab3a-024ad512ee05,created_at=2026-11-02T08:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1293764527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f78917b5-a16f-4837-ab3a-024ad512ee05,host='devstack@QuobyteHD#QuobyteHD',id=33a7a361-101b-406a-bc88-43572ad71da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4606e815fb194b29913fe1f2f8cffa2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:12Z,use_quota=True,user_id='63dc80f4a360419282fd674c46d078f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65f71a94-ffe5-4e4f-a048-e3c06694c705),volume_type_id=65f71a94-ffe5-4e4f-a048-e3c06694c705)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Creating volume 33a7a361-101b-406a-bc88-43572ad71da6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:39:11 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:39:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:11 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 1073741824 Nov 02 09:39:11 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:12 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b" returned: 0 in 0.520s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:12 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b Nov 02 09:39:12 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:12 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6.771e4604-6e1d-48c4-8f5a-c20a6b34583b" returned: 0 in 0.322s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:12 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 1073741824" returned: 0 in 0.645s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-771e4604-6e1d-48c4-8f5a-c20a6b34583b" released by "_delete_snapshot" :: held 2.391s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" released by "delete_snapshot" :: held 2.437s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:12 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 Nov 02 09:39:12 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:12 devstack cinder-volume[86887]: WARNING cinder.quota [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-113031204 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-113031204, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:12 devstack cinder-volume[86887]: WARNING cinder.quota [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-113031204 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-113031204, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:12 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] Created reservations ['740ea437-1c1c-44ba-9269-6915b907e849', '549a3468-8a0c-414e-87dc-857eec151244', 'af2c66a9-b9ce-433d-9b4c-31c67b63dcfe', '93cdfe84-16a9-4caf-aba5-1c4e7a404a46'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-daea7b2d-c683-484b-b410-2a72b4c4f0a2 tempest-GroupSnapshotsV319Test-1947743936 None] group_snapshot ef9cb0c6-29b9-48d7-b9b8-5831827d96c5: deleted successfully Nov 02 09:39:13 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6" returned: 0 in 0.529s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef4f17c-337b-4131-b8ba-5f561c68fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a7a361-101b-406a-bc88-43572ad71da6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64de8168-0d5e-4818-8061-2ef1b491ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Volume volume-33a7a361-101b-406a-bc88-43572ad71da6 (33a7a361-101b-406a-bc88-43572ad71da6): created successfully Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64de8168-0d5e-4818-8061-2ef1b491ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Flow 'volume_create_manager' (f84bf49d-d918-415e-84ca-92db98b0c678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2a420c23-dea0-4c04-a56c-bdc7d5e20366 tempest-GroupsTest-667909122 None] Created volume successfully. Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1554fae-c207-44e8-b407-23b2255d205f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:14 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 Nov 02 09:39:14 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:14 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6eaeb132-bc72-48a0-bae9-9c055a2a7ed4 tempest-GroupsTest-667909122 None] Update group completed successfully. Nov 02 09:39:14 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6" returned: 0 in 0.791s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:14 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6 Nov 02 09:39:14 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:15 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a920292d-9053-4861-81a6-ac4ce05ca3b6" returned: 0 in 0.318s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "cinder-quobyte-a920292d-9053-4861-81a6-ac4ce05ca3b6" released by "delete_volume" :: held 1.224s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Created reservations ['bd08ecfc-d088-4b06-9b76-7e4f973bcb5e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:15 devstack cinder-volume[86887]: WARNING cinder.quota [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-113031204 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-113031204, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Created reservations ['cce00bdd-ad60-431c-8b44-af405ac23623', '49a7e511-b937-4b07-9ce7-6c69abea4e8c', '25ff9225-1247-4c8a-b462-004b294833be', '0610cd3b-f998-4dff-829c-25a29b9e6196'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:15 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:15 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:16 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.458s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:16 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-393d3b09-be81-478a-82cc-83e3e070b8d6 tempest-GroupSnapshotsV319Test-1947743936 None] Delete group completed successfully. Nov 02 09:39:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-887f8f24-79a0-4f04-a2b8-53e2c8321cde tempest-GroupsTest-667909122 None] Update group completed successfully. Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=111,cinder:SELECT=122,cinder:INSERT=28,cinder:DELETE=9 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=126,cinder:INSERT=34,cinder:UPDATE=128,cinder:DELETE=6 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Acquiring lock "cinder-quobyte-33a7a361-101b-406a-bc88-43572ad71da6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-33a7a361-101b-406a-bc88-43572ad71da6" acquired by "delete_volume" :: waited 0.058s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0090b-d446-4a78-84a8-e8c80d029b5d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:19 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 Nov 02 09:39:19 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:19 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6" returned: 0 in 0.559s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:19 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6 Nov 02 09:39:19 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:19 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-33a7a361-101b-406a-bc88-43572ad71da6" returned: 0 in 0.357s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-33a7a361-101b-406a-bc88-43572ad71da6" released by "delete_volume" :: held 1.029s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Acquiring lock "cinder-quobyte-9315cd35-d851-4ff0-a2d4-2444aa224f2a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-9315cd35-d851-4ff0-a2d4-2444aa224f2a" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cc5dc6-4fad-4eb7-ae2c-8dde70a9daf1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:20 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a Nov 02 09:39:20 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:20 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a" returned: 0 in 0.582s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:20 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a Nov 02 09:39:20 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:20 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9315cd35-d851-4ff0-a2d4-2444aa224f2a" returned: 0 in 0.343s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "cinder-quobyte-9315cd35-d851-4ff0-a2d4-2444aa224f2a" released by "delete_volume" :: held 0.979s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:20 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Created reservations ['1530ef73-6bee-4266-b801-0b83be7b7c5d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:21 devstack cinder-volume[86887]: WARNING cinder.quota [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1840398604 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1840398604, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:21 devstack cinder-volume[86887]: WARNING cinder.quota [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1840398604 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1840398604, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Created reservations ['2b984648-2df4-40b8-b4cd-f64740e79a52', '37ad4981-5509-4df7-bb01-1c8d1b542fa1', '4eac5349-af35-4f7a-8df5-b694105f3656', 'c9679514-6563-4152-ac93-78c7a94a9116'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Created reservations ['912fd9ac-0abf-4e89-bcfa-3a1d7c368d00', '5cc702e9-6e23-4ccd-a0a0-4e39cd599d32', 'c568e33e-9555-49df-94cc-75924cc2a470', '0ca1cd7a-362e-411f-a100-ebae28476b53'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:21 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:21 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:21 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:21 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-22e36136-5be2-4444-befe-6e7d1ff9adbd tempest-GroupsTest-667909122 None] Delete group completed successfully. Nov 02 09:39:31 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=10,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:39:31 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:39:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-74076eb5-16d6-4ee6-98b9-c36aee4d9fa4 tempest-GroupsV314Test-1381357985 None] Group tempest-GroupsV314Test-Group-1270467495: creating Nov 02 09:39:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-74076eb5-16d6-4ee6-98b9-c36aee4d9fa4 tempest-GroupsV314Test-1381357985 None] Group tempest-GroupsV314Test-Group-1270467495: created successfully Nov 02 09:39:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-74076eb5-16d6-4ee6-98b9-c36aee4d9fa4 tempest-GroupsV314Test-1381357985 None] Create group completed successfully. Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Flow 'volume_create_manager' (ecc8d742-1aa8-4cf8-b21d-8865eb230aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4237df0-539e-452c-ae6f-858845300610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4237df0-539e-452c-ae6f-858845300610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1966093262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f41fcb3a-e3ca-4f76-b956-44cebbc988a4,host='devstack@QuobyteHD#QuobyteHD',id=0f896958-f910-4879-9622-e15a805268db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9360516ea6ed49a6a82a2aadf612b10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:34Z,use_quota=True,user_id='49357ae300c542c8a25ff285119a9150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35c01ffc-9544-4ac3-af17-3a9635a4848a),volume_type_id=35c01ffc-9544-4ac3-af17-3a9635a4848a)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b398e192-25e0-437c-bc03-2a5665a5d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b398e192-25e0-437c-bc03-2a5665a5d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1265a82f-2d49-4f46-81f1-8c77ca4a939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1265a82f-2d49-4f46-81f1-8c77ca4a939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f896958-f910-4879-9622-e15a805268db', 'volume_name': 'volume-0f896958-f910-4879-9622-e15a805268db', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d614ee-dc1a-4b0f-a424-f7ae9d585129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d614ee-dc1a-4b0f-a424-f7ae9d585129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba567b34-0f02-4fde-84ed-997629552b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:34 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Volume 0f896958-f910-4879-9622-e15a805268db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f896958-f910-4879-9622-e15a805268db', 'volume_size': 1} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f41fcb3a-e3ca-4f76-b956-44cebbc988a4,created_at=2026-11-02T08:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1966093262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f41fcb3a-e3ca-4f76-b956-44cebbc988a4,host='devstack@QuobyteHD#QuobyteHD',id=0f896958-f910-4879-9622-e15a805268db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9360516ea6ed49a6a82a2aadf612b10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:39:34Z,use_quota=True,user_id='49357ae300c542c8a25ff285119a9150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35c01ffc-9544-4ac3-af17-3a9635a4848a),volume_type_id=35c01ffc-9544-4ac3-af17-3a9635a4848a)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Creating volume 0f896958-f910-4879-9622-e15a805268db {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:39:34 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:34 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db 1073741824 Nov 02 09:39:34 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:34 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db 1073741824" returned: 0 in 0.813s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:35 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:39:35 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:35 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 0.279s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba567b34-0f02-4fde-84ed-997629552b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f896958-f910-4879-9622-e15a805268db', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40657c-7ef4-4741-b7f3-e06e745aeef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:39:35 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Volume volume-0f896958-f910-4879-9622-e15a805268db (0f896958-f910-4879-9622-e15a805268db): created successfully Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e40657c-7ef4-4741-b7f3-e06e745aeef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:39:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Flow 'volume_create_manager' (ecc8d742-1aa8-4cf8-b21d-8865eb230aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:39:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7a0c9dfd-48cc-474b-9698-6c1a6fdabeff tempest-GroupsV314Test-1381357985 None] Created volume successfully. Nov 02 09:39:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:37 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Cloning volume 0f896958-f910-4879-9622-e15a805268db to volume eb7893e7-7a87-4af7-b311-e73c2255b96e Nov 02 09:39:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Creating offline snapshot bbee04bf-5867-4193-8187-472690707759 of volume 0f896958-f910-4879-9622-e15a805268db {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:39:37 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf6587-8cd9-4276-baba-6621eb0d463e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:37 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:39:37 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:37 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 0.433s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:38 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 1G Nov 02 09:39:38 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:38 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 1G" returned: 0 in 0.481s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f896958-f910-4879-9622-e15a805268db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:38 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f896958-f910-4879-9622-e15a805268db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:38 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:38 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f896958-f910-4879-9622-e15a805268db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.370s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:38 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:39:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:38 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:38 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:39 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.347s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:39 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info Nov 02 09:39:39 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:39 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:39 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:39:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:39 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info Nov 02 09:39:39 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:40 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.info" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Acquiring lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] snapshot: bbee04bf-5867-4193-8187-472690707759, volume: eb7893e7-7a87-4af7-b311-e73c2255b96e, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13cd4d-63ed-48fd-b04f-6bdf657d4f60]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:40 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:40 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:40 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.707s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f896958-f910-4879-9622-e15a805268db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c82fc7-4178-4676-8cc1-f17952f5c270]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:41 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:39:41 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:41 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 0.569s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:39:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:39:41 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:39:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:41 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e Nov 02 09:39:41 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-1835f775-45b3-40f6-976b-9ed3de6c0c7f tempest-ServerActionsTestOtherA-2147184767 None] Terminate volume connection completed successfully. Nov 02 09:39:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-1835f775-45b3-40f6-976b-9ed3de6c0c7f tempest-ServerActionsTestOtherA-2147184767 None] Deleting attachment ee73aa66-22a9-4cad-b7ba-7036465407f5. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "cinder-24307046-2d06-499f-b2f7-b1d8c694986e-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-24307046-2d06-499f-b2f7-b1d8c694986e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "cinder-quobyte-24307046-2d06-499f-b2f7-b1d8c694986e" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-quobyte-24307046-2d06-499f-b2f7-b1d8c694986e" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f9291-5cea-4b19-9c59-446d2fa1ea95]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:44 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e Nov 02 09:39:44 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "cinder-6f902fdb-fade-412c-b26a-ef1a83b371a5-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-6f902fdb-fade-412c-b26a-ef1a83b371a5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:45 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e" returned: 0 in 1.098s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:45 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e Nov 02 09:39:45 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "cinder-quobyte-6f902fdb-fade-412c-b26a-ef1a83b371a5" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-quobyte-6f902fdb-fade-412c-b26a-ef1a83b371a5" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4879011b-c37c-4f1e-b415-ed0296a3994a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:46 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 Nov 02 09:39:46 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:46 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-24307046-2d06-499f-b2f7-b1d8c694986e" returned: 0 in 0.954s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-quobyte-24307046-2d06-499f-b2f7-b1d8c694986e" released by "delete_volume" :: held 2.219s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:46 devstack cinder-volume[86887]: DEBUG cinder.quota [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Created reservations ['60f5f821-9249-414b-be1e-8b3630c62c9b', '0fa9e837-1ce7-41e6-926e-708dff84d493', 'c55831a9-7606-42cc-9ae7-879b872013ef', 'dff30007-18d4-4e9a-8f1f-cd8e36967ae7'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:47 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5" returned: 0 in 1.320s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:47 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5 Nov 02 09:39:47 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:47 devstack sudo[92985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:47 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:47 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.628s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG cinder.manager [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Deleted volume successfully. Nov 02 09:39:47 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f902fdb-fade-412c-b26a-ef1a83b371a5" returned: 0 in 0.746s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-140c4771-50c5-4dea-80ef-d28d5e8e243a req-4bef3aa4-54b5-4f3c-99e4-02d9f7af8433 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-24307046-2d06-499f-b2f7-b1d8c694986e-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-quobyte-6f902fdb-fade-412c-b26a-ef1a83b371a5" released by "delete_volume" :: held 2.187s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Created reservations ['62dea72f-b0d9-408a-b46c-7d7c68f1dacd', '172cb41c-69b7-4bc3-a445-65a80b0b0300', 'a3a48841-e0c1-423b-a12f-5ddca4d1bf47', '308c92a7-3ab6-4fa7-b9e1-5b20d866bc03'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:48 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:48 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:48 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.703s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:48 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Deleted volume successfully. Nov 02 09:39:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-19074100-224b-461f-8082-d8342cdd34b5 tempest-ServerActionsTestOtherA-2147184767 None] Lock "cinder-6f902fdb-fade-412c-b26a-ef1a83b371a5-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e" returned: 0 in 10.938s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:52 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db, size 1024.00 MB, duration 10.94 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:39:52 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Converted 1024.00 MB image at 93.61 MB/s Nov 02 09:39:52 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:39:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:52 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e Nov 02 09:39:52 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:53 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e" returned: 0 in 0.674s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" released by "_copy_volume_from_snapshot" :: held 13.048s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Acquiring lock "cinder-quobyte-bbee04bf-5867-4193-8187-472690707759" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-bbee04bf-5867-4193-8187-472690707759" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Deleting offline snapshot bbee04bf-5867-4193-8187-472690707759 of volume 0f896958-f910-4879-9622-e15a805268db {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] snapshot_file for this snap is: volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f246cf99-c1ff-4830-827d-399bfed0ca49]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:53 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:53 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:54 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.856s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f896958-f910-4879-9622-e15a805268db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:39:54 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[83392b39-6fe2-43a2-bd72-49abd8e32c25]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:54 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:39:54 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:55 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 1.200s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:55 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:55 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:56 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.684s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:56 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759 Nov 02 09:39:56 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:56 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db.bbee04bf-5867-4193-8187-472690707759" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-bbee04bf-5867-4193-8187-472690707759" released by "_delete_snapshot" :: held 3.493s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.292s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cb404634-8a8d-48fc-90bf-1030a7e4e87b tempest-GroupsV314Test-1381357985 None] Create group from source-group-f41fcb3a-e3ca-4f76-b956-44cebbc988a4 completed successfully. Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:58 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:58 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:58 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Acquiring lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[88955156-133f-4338-9551-37cca04dd6fd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:39:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:58 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e Nov 02 09:39:58 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:59 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e" returned: 0 in 0.474s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:59 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e Nov 02 09:39:59 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:39:59 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-eb7893e7-7a87-4af7-b311-e73c2255b96e" returned: 0 in 0.355s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-eb7893e7-7a87-4af7-b311-e73c2255b96e" released by "delete_volume" :: held 0.965s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Created reservations ['1c933af4-4081-4cf8-be94-dea7f03d2b31'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:59 devstack cinder-volume[86887]: WARNING cinder.quota [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1710541316 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1710541316, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:59 devstack cinder-volume[86887]: WARNING cinder.quota [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1710541316 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1710541316, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Created reservations ['3303b036-76be-40cf-ab8f-e0c3d35536f4', '29bd7112-e67a-4342-bb39-04cc17b4aefa', 'd667dff8-f546-4503-9eb3-1153dee4827e', 'd4acd773-71d1-492d-864f-7709e49ecf86'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:39:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:39:59 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:39:59 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:00 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.275s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1b1d8296-7fdc-44f1-afc8-8fa1a9e47c40 tempest-GroupsV314Test-1381357985 None] Delete group completed successfully. Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Acquiring lock "cinder-quobyte-0f896958-f910-4879-9622-e15a805268db" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-0f896958-f910-4879-9622-e15a805268db" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6ad3a-a33e-425e-a889-bf27c1a20a1e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:40:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:00 devstack sudo[93126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:40:00 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:01 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 0.648s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:01 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db Nov 02 09:40:01 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:01 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0f896958-f910-4879-9622-e15a805268db" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Lock "cinder-quobyte-0f896958-f910-4879-9622-e15a805268db" released by "delete_volume" :: held 1.121s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Created reservations ['178f92d9-c62c-42e3-a0f3-c192abc0052b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Created reservations ['48421c23-24f0-4a6e-b824-2d0ae2f042ce', 'f1d2e3c5-49de-45fb-9b3a-ea091699620f', 'dcc9f253-c97e-4c6a-8231-8565ee4ef55f', '3fa889ea-9dda-46b5-b28d-f40e17836a6d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:02 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:02 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:02 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.435s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:02 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4500322c-2e1a-4729-8f1f-a6ac661d889d tempest-GroupsV314Test-1381357985 None] Delete group completed successfully. Nov 02 09:40:12 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:40:12 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=43,cinder:UPDATE=46,cinder:INSERT=14 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Flow 'volume_create_manager' (3261685a-d758-4f29-ace2-b83df1b30f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473a3600-3383-4a35-9dfb-6b9338a2bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473a3600-3383-4a35-9dfb-6b9338a2bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1783394658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53939cc5-c572-4872-a44f-09da731c344b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d1716c9554b0580b99aa55e388a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:14Z,use_quota=True,user_id='e927c65863b04f84834bfcedff86434e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7af0ff-b68a-4372-b7c8-08143f630ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7af0ff-b68a-4372-b7c8-08143f630ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f8f919-348c-453c-8f8e-514899410136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f8f919-348c-453c-8f8e-514899410136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53939cc5-c572-4872-a44f-09da731c344b', 'volume_name': 'volume-53939cc5-c572-4872-a44f-09da731c344b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e6d14-e572-4a87-a48d-86db954f7236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588e6d14-e572-4a87-a48d-86db954f7236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0f4fe4-9e6a-425b-bb99-01a5cef0d93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Volume 53939cc5-c572-4872-a44f-09da731c344b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53939cc5-c572-4872-a44f-09da731c344b', 'volume_size': 1} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1783394658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53939cc5-c572-4872-a44f-09da731c344b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091d1716c9554b0580b99aa55e388a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:14Z,use_quota=True,user_id='e927c65863b04f84834bfcedff86434e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Creating volume 53939cc5-c572-4872-a44f-09da731c344b {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:13 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:13 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b 1073741824 Nov 02 09:40:13 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:14 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b 1073741824" returned: 0 in 0.825s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:14 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b Nov 02 09:40:14 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:15 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b" returned: 0 in 0.326s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0f4fe4-9e6a-425b-bb99-01a5cef0d93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53939cc5-c572-4872-a44f-09da731c344b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa09869-7d2d-4f90-86fe-cc72355242d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:15 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Volume volume-53939cc5-c572-4872-a44f-09da731c344b (53939cc5-c572-4872-a44f-09da731c344b): created successfully Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa09869-7d2d-4f90-86fe-cc72355242d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Flow 'volume_create_manager' (3261685a-d758-4f29-ace2-b83df1b30f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7d53440e-af29-4698-a339-799018f04f11 tempest-AbsoluteLimitsTests-49402376 None] Created volume successfully. Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Acquiring lock "cinder-53939cc5-c572-4872-a44f-09da731c344b-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "cinder-53939cc5-c572-4872-a44f-09da731c344b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Acquiring lock "cinder-quobyte-53939cc5-c572-4872-a44f-09da731c344b" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "cinder-quobyte-53939cc5-c572-4872-a44f-09da731c344b" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b49dc-470e-420d-bdf9-eb3d23a0d95a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:40:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:16 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b Nov 02 09:40:16 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:17 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b" returned: 0 in 0.536s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:17 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b Nov 02 09:40:17 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:17 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-53939cc5-c572-4872-a44f-09da731c344b" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "cinder-quobyte-53939cc5-c572-4872-a44f-09da731c344b" released by "delete_volume" :: held 0.996s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:17 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Created reservations ['ce754b50-d036-4a3e-9987-0ab365e294a3', '5b30f479-a307-4683-901c-f9dbb044f6b6', '6f307e1e-7cd5-4013-a42a-586891337a31', '1a2ebbbc-5667-49ac-9d49-e146c7e7bd4e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:18 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:18 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (ecd5ecb7-6dfb-4e75-9be4-0df6826728bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d1818-fc32-46a8-924d-cf71902ac21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d1818-fc32-46a8-924d-cf71902ac21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1956988505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74de7428-3aa2-4751-ba5c-36e33292ce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:18Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:18 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1420f3-b0a2-4fb3-9282-171614819f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1420f3-b0a2-4fb3-9282-171614819f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c1996-c762-49e5-9685-224b3f3ff483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83c1996-c762-49e5-9685-224b3f3ff483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74de7428-3aa2-4751-ba5c-36e33292ce6a', 'volume_name': 'volume-74de7428-3aa2-4751-ba5c-36e33292ce6a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b85f1fb-6123-4242-9922-369a5220323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b85f1fb-6123-4242-9922-369a5220323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f70b55f-2f37-4953-8009-d77adc4d2488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Volume 74de7428-3aa2-4751-ba5c-36e33292ce6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74de7428-3aa2-4751-ba5c-36e33292ce6a', 'volume_size': 1} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1956988505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74de7428-3aa2-4751-ba5c-36e33292ce6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:18Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Creating volume 74de7428-3aa2-4751-ba5c-36e33292ce6a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:18 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.526s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:18 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a 1073741824 Nov 02 09:40:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Deleted volume successfully. Nov 02 09:40:18 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43431189-a473-45e3-92a7-77b09b4b0b77 tempest-AbsoluteLimitsTests-49402376 None] Lock "cinder-53939cc5-c572-4872-a44f-09da731c344b-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:19 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a 1073741824" returned: 0 in 0.750s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:19 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a Nov 02 09:40:19 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:19 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f70b55f-2f37-4953-8009-d77adc4d2488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74de7428-3aa2-4751-ba5c-36e33292ce6a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48769a8-9156-48e1-8633-a1bab7040201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Volume volume-74de7428-3aa2-4751-ba5c-36e33292ce6a (74de7428-3aa2-4751-ba5c-36e33292ce6a): created successfully Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48769a8-9156-48e1-8633-a1bab7040201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (ecd5ecb7-6dfb-4e75-9be4-0df6826728bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-466f4225-ba0d-4630-a1cf-f4712e0b15e7 tempest-AttachVolumeTestJSON-971588719 None] Created volume successfully. Nov 02 09:40:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-415087ee-e127-46ba-bc8c-ddb8943177a9 req-95670769-4997-4742-842e-0e6c65f811d6 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-415087ee-e127-46ba-bc8c-ddb8943177a9 req-95670769-4997-4742-842e-0e6c65f811d6 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-415087ee-e127-46ba-bc8c-ddb8943177a9 req-95670769-4997-4742-842e-0e6c65f811d6 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-415087ee-e127-46ba-bc8c-ddb8943177a9 req-95670769-4997-4742-842e-0e6c65f811d6 tempest-AttachVolumeTestJSON-971588719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-74de7428-3aa2-4751-ba5c-36e33292ce6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c455bfb-9091-49a6-bb62-aad620404498', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:40:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-415087ee-e127-46ba-bc8c-ddb8943177a9 req-95670769-4997-4742-842e-0e6c65f811d6 tempest-AttachVolumeTestJSON-971588719 None] attachment_update completed successfully. Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Flow 'volume_create_manager' (a7aa347c-be1b-4fd9-98a0-ee4177685e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a17c99e-4b23-4c81-8993-39592d8910b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a17c99e-4b23-4c81-8993-39592d8910b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1266491224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba233bf7-4a1c-4f6c-8003-f2f00ec0f009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4dac7cdee3408494d8226023b588b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:25Z,use_quota=True,user_id='3b958c6e926a4b4898d7de39e6cc40f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49db09c5-3942-40a0-9dad-232edd09c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49db09c5-3942-40a0-9dad-232edd09c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d178bd4-2738-4a19-a2fb-ca6be50df393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d178bd4-2738-4a19-a2fb-ca6be50df393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba233bf7-4a1c-4f6c-8003-f2f00ec0f009', 'volume_name': 'volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee7610-c122-4c3c-a808-29b4f574abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ee7610-c122-4c3c-a808-29b4f574abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ad7e7-6196-4953-84db-7434db81134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Volume ba233bf7-4a1c-4f6c-8003-f2f00ec0f009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009', 'volume_size': 1} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1266491224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba233bf7-4a1c-4f6c-8003-f2f00ec0f009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4dac7cdee3408494d8226023b588b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:25Z,use_quota=True,user_id='3b958c6e926a4b4898d7de39e6cc40f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Creating volume ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:25 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:25 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 1073741824 Nov 02 09:40:25 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:26 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 1073741824" returned: 0 in 0.810s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:26 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 Nov 02 09:40:26 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:26 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ad7e7-6196-4953-84db-7434db81134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb26777-1631-49c2-a6b1-fc048cdc575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:26 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Volume volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 (ba233bf7-4a1c-4f6c-8003-f2f00ec0f009): created successfully Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb26777-1631-49c2-a6b1-fc048cdc575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Flow 'volume_create_manager' (a7aa347c-be1b-4fd9-98a0-ee4177685e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-aafc575f-dcf4-424d-b27b-583503f7ab52 tempest-VolumesServicesTestJSON-707803585 None] Created volume successfully. Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Acquiring lock "cinder-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "cinder-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Acquiring lock "cinder-quobyte-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "cinder-quobyte-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Flow 'volume_create_manager' (9f35dac7-be11-477e-81da-04d8d470c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd25322c-741c-4e73-9818-ed5a1889862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd03d8-bffa-4b65-8280-31a51cdc05f1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd25322c-741c-4e73-9818-ed5a1889862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1636399441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebddf70-1b71-49a2-83ff-97780e4ad03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e6ed175b164b21bf2cfded64e67b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:28Z,use_quota=True,user_id='c151afbb121741b2ae6f7347dabda6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3addf941-00b3-42e6-9f71-d5979dfb8902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3addf941-00b3-42e6-9f71-d5979dfb8902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb64187f-4e1b-4101-ae69-e94a58c36297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb64187f-4e1b-4101-ae69-e94a58c36297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ebddf70-1b71-49a2-83ff-97780e4ad03d', 'volume_name': 'volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13665103-8cf1-4147-81b7-27d47dad26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13665103-8cf1-4147-81b7-27d47dad26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156dd589-9260-4d2e-a222-630c096a3d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:28 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Volume 9ebddf70-1b71-49a2-83ff-97780e4ad03d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d', 'volume_size': 1} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1636399441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ebddf70-1b71-49a2-83ff-97780e4ad03d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e6ed175b164b21bf2cfded64e67b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:28Z,use_quota=True,user_id='c151afbb121741b2ae6f7347dabda6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Creating volume 9ebddf70-1b71-49a2-83ff-97780e4ad03d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:28 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:28 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 Nov 02 09:40:28 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:28 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d 1073741824 Nov 02 09:40:28 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:28 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" returned: 0 in 0.663s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:28 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009 Nov 02 09:40:28 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:29 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d 1073741824" returned: 0 in 1.020s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:29 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d Nov 02 09:40:29 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:29 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" returned: 0 in 0.835s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "cinder-quobyte-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009" released by "delete_volume" :: held 1.677s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:29 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d" returned: 0 in 0.527s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156dd589-9260-4d2e-a222-630c096a3d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e16a7-a993-4134-9352-8565795918c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Created reservations ['11246c10-b18c-4205-bf29-e0fa485841c1', 'bd01e2d5-cad2-45ab-9e4e-a661e8d695e3', 'b3d8024b-7a16-45e9-ae3b-e6f5f05bbdbb', '243eb49b-34eb-401e-8595-e4fc03259372'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:29 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Volume volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d (9ebddf70-1b71-49a2-83ff-97780e4ad03d): created successfully Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e16a7-a993-4134-9352-8565795918c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Flow 'volume_create_manager' (9f35dac7-be11-477e-81da-04d8d470c094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:29 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e974989c-01f9-4912-a3f9-f6dae892363a tempest-VolumesMetadataTest-615898762 None] Created volume successfully. Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:30 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:30 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:31 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.889s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:31 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Deleted volume successfully. Nov 02 09:40:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-910fa94c-e459-44a9-90f4-5da0d57ec50c tempest-VolumesServicesTestJSON-707803585 None] Lock "cinder-ba233bf7-4a1c-4f6c-8003-f2f00ec0f009-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Acquiring lock "cinder-9ebddf70-1b71-49a2-83ff-97780e4ad03d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "cinder-9ebddf70-1b71-49a2-83ff-97780e4ad03d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Acquiring lock "cinder-quobyte-9ebddf70-1b71-49a2-83ff-97780e4ad03d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "cinder-quobyte-9ebddf70-1b71-49a2-83ff-97780e4ad03d" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be1a8a-afb1-4d9d-a040-489ed9958d6d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:40:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:34 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d Nov 02 09:40:34 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:34 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d" returned: 0 in 0.882s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:34 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d Nov 02 09:40:34 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:35 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ebddf70-1b71-49a2-83ff-97780e4ad03d" returned: 0 in 0.582s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "cinder-quobyte-9ebddf70-1b71-49a2-83ff-97780e4ad03d" released by "delete_volume" :: held 1.573s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Created reservations ['fb5907f7-2f0d-4f0e-9681-bcbb780cfd34', '734a216d-07a2-400b-bced-10cf9df3a2a5', 'a6e6a501-1485-45bb-8a88-ba761d9ed0ba', '3bd9e1a8-9d71-47e6-b66e-b8315473ead3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:35 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:35 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:36 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.468s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:36 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Deleted volume successfully. Nov 02 09:40:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5f26d228-b84c-4f82-9eee-515ee90b33b5 tempest-VolumesMetadataTest-615898762 None] Lock "cinder-9ebddf70-1b71-49a2-83ff-97780e4ad03d-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:45 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=40,cinder:SELECT=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Flow 'volume_create_manager' (48305eda-3164-48c2-8875-4a23ab8fbc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84708cbf-03e8-4aad-8ee5-68242b895b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84708cbf-03e8-4aad-8ee5-68242b895b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1394316024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4291e-60eb-488c-aa0d-bff74eea7a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e969121c6efa4b09bdd9f07b09ae8feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:50Z,use_quota=True,user_id='5d49d7b99ac34bd581c14a7eb761a140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77dec11-2932-4dec-8d8a-29ef6750c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77dec11-2932-4dec-8d8a-29ef6750c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642c6838-84a6-46fa-a3cb-f9eb51e62065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642c6838-84a6-46fa-a3cb-f9eb51e62065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b4291e-60eb-488c-aa0d-bff74eea7a1d', 'volume_name': 'volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7125b0-1544-4648-bbcf-dbe89a352a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7125b0-1544-4648-bbcf-dbe89a352a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e79be-f2f2-4f03-9f02-0418fbb6ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Volume 88b4291e-60eb-488c-aa0d-bff74eea7a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d', 'volume_size': 1} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1394316024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4291e-60eb-488c-aa0d-bff74eea7a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e969121c6efa4b09bdd9f07b09ae8feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:50Z,use_quota=True,user_id='5d49d7b99ac34bd581c14a7eb761a140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Creating volume 88b4291e-60eb-488c-aa0d-bff74eea7a1d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:50 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:50 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d 1073741824 Nov 02 09:40:50 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:50 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d 1073741824" returned: 0 in 0.704s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:50 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d Nov 02 09:40:50 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:51 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d" returned: 0 in 0.362s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6e79be-f2f2-4f03-9f02-0418fbb6ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86284323-8089-450c-a79a-9202948a9749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Volume volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d (88b4291e-60eb-488c-aa0d-bff74eea7a1d): created successfully Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86284323-8089-450c-a79a-9202948a9749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Flow 'volume_create_manager' (48305eda-3164-48c2-8875-4a23ab8fbc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:51 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fcf6c6c4-069f-4de8-95b0-211b51dc563a tempest-VolumesTransfersTest-606493914 None] Created volume successfully. Nov 02 09:40:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dc6653e9-29e2-40c2-9a03-613dbcac5e87 tempest-VolumesTransfersTest-1631625294 None] Transfer volume completed successfully. Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Flow 'volume_create_manager' (56a53f27-ca74-4866-85a0-cb0a7b227926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f1637e-a6a1-41ab-9593-aa8c32c46fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f1637e-a6a1-41ab-9593-aa8c32c46fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1307043980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f611830-0832-412f-955c-6a1f7f118c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9658660cd125419fbb68c450b0aacd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:54Z,use_quota=True,user_id='bc8da1d31bb84f609252e5109b2a42c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa5620a-c38e-4a36-bfae-0549e85c71de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa5620a-c38e-4a36-bfae-0549e85c71de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76172f52-8f2b-48bd-bb35-397027a00dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76172f52-8f2b-48bd-bb35-397027a00dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f611830-0832-412f-955c-6a1f7f118c09', 'volume_name': 'volume-3f611830-0832-412f-955c-6a1f7f118c09', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d79521-07af-4609-a2c9-d11829d3f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d79521-07af-4609-a2c9-d11829d3f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bd6bc8-f621-4508-8260-4b1120204832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Volume 3f611830-0832-412f-955c-6a1f7f118c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f611830-0832-412f-955c-6a1f7f118c09', 'volume_size': 1} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1307043980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f611830-0832-412f-955c-6a1f7f118c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9658660cd125419fbb68c450b0aacd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:54Z,use_quota=True,user_id='bc8da1d31bb84f609252e5109b2a42c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Creating volume 3f611830-0832-412f-955c-6a1f7f118c09 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:54 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:54 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 1073741824 Nov 02 09:40:54 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Acquiring lock "cinder-88b4291e-60eb-488c-aa0d-bff74eea7a1d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "cinder-88b4291e-60eb-488c-aa0d-bff74eea7a1d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Acquiring lock "cinder-quobyte-88b4291e-60eb-488c-aa0d-bff74eea7a1d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "cinder-quobyte-88b4291e-60eb-488c-aa0d-bff74eea7a1d" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d759b86-01ae-410d-89b2-d0f8fae75682]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:54 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 1073741824" returned: 0 in 0.708s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:54 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d Nov 02 09:40:54 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:55 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 Nov 02 09:40:55 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:55 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d" returned: 0 in 0.546s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:55 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09" returned: 0 in 0.357s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:55 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d Nov 02 09:40:55 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bd6bc8-f621-4508-8260-4b1120204832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f611830-0832-412f-955c-6a1f7f118c09', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8e638-58c8-439b-847c-4a0aa58fbc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Volume volume-3f611830-0832-412f-955c-6a1f7f118c09 (3f611830-0832-412f-955c-6a1f7f118c09): created successfully Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a8e638-58c8-439b-847c-4a0aa58fbc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Flow 'volume_create_manager' (56a53f27-ca74-4866-85a0-cb0a7b227926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c80c01a1-46c8-4ebe-a683-b183de697d94 tempest-ServersNegativeTestJSON-788018966 None] Created volume successfully. Nov 02 09:40:55 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-88b4291e-60eb-488c-aa0d-bff74eea7a1d" returned: 0 in 0.332s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "cinder-quobyte-88b4291e-60eb-488c-aa0d-bff74eea7a1d" released by "delete_volume" :: held 0.955s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Created reservations ['42d60a52-e6a7-4915-a2be-b8482e12eb64', '384c3312-7bb4-4c34-beef-7cddeb0a5cfa', '21920327-04d3-4a53-998f-8c0f2e681c98', '23b93dee-c70a-4fdf-a95e-6aee6ec88a3b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:55 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:55 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:56 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:56 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Deleted volume successfully. Nov 02 09:40:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d350802d-8b8b-4dc9-b52d-d2cb90bbee4f tempest-VolumesTransfersTest-516180736 None] Lock "cinder-88b4291e-60eb-488c-aa0d-bff74eea7a1d-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Flow 'volume_create_manager' (e30a1661-d943-4e88-9123-f9ca632904e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b41b8f-9b9a-486d-84ff-fc3dc1562fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b41b8f-9b9a-486d-84ff-fc3dc1562fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-490076127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afbe52-3733-4b23-904e-36e237b403c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e969121c6efa4b09bdd9f07b09ae8feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:57Z,use_quota=True,user_id='5d49d7b99ac34bd581c14a7eb761a140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a973063-8639-4017-aee7-e844ce6c6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a973063-8639-4017-aee7-e844ce6c6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96941bb-1c94-48ff-aa36-f43642452eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96941bb-1c94-48ff-aa36-f43642452eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5afbe52-3733-4b23-904e-36e237b403c4', 'volume_name': 'volume-c5afbe52-3733-4b23-904e-36e237b403c4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0347bea4-81de-4d62-b6f8-4385e02c62c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0347bea4-81de-4d62-b6f8-4385e02c62c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f479fe5-568b-438a-96fe-07c82698f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Volume c5afbe52-3733-4b23-904e-36e237b403c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5afbe52-3733-4b23-904e-36e237b403c4', 'volume_size': 1} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-490076127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5afbe52-3733-4b23-904e-36e237b403c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e969121c6efa4b09bdd9f07b09ae8feb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:57Z,use_quota=True,user_id='5d49d7b99ac34bd581c14a7eb761a140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Creating volume c5afbe52-3733-4b23-904e-36e237b403c4 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:57 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:57 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 1073741824 Nov 02 09:40:57 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Flow 'volume_create_manager' (ba7e7cae-637c-4021-bff6-de5acb837544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff20b3db-a2ee-4dfa-a378-21bd33fd25c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff20b3db-a2ee-4dfa-a378-21bd33fd25c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2127263674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c69a388-e779-4044-8333-999d4a5f35d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9658660cd125419fbb68c450b0aacd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:58Z,use_quota=True,user_id='bc8da1d31bb84f609252e5109b2a42c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd8d8fd-3fd2-4fe3-894a-d36790da55e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd8d8fd-3fd2-4fe3-894a-d36790da55e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1f731-e229-4e08-8c3e-40dbae604c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec1f731-e229-4e08-8c3e-40dbae604c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c69a388-e779-4044-8333-999d4a5f35d8', 'volume_name': 'volume-8c69a388-e779-4044-8333-999d4a5f35d8', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9814fb4f-f875-4ad4-b3fa-2cda05178149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9814fb4f-f875-4ad4-b3fa-2cda05178149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61236f97-c7f9-4607-adb9-5babb8a891b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Volume 8c69a388-e779-4044-8333-999d4a5f35d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c69a388-e779-4044-8333-999d4a5f35d8', 'volume_size': 1} Nov 02 09:40:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:58 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 1073741824" returned: 0 in 0.537s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:58 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:40:58 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:58 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 Nov 02 09:40:58 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:58 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.360s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:40:58 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4" returned: 0 in 0.326s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2127263674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c69a388-e779-4044-8333-999d4a5f35d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9658660cd125419fbb68c450b0aacd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:40:58Z,use_quota=True,user_id='bc8da1d31bb84f609252e5109b2a42c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Creating volume 8c69a388-e779-4044-8333-999d4a5f35d8 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:40:58 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:58 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 1073741824 Nov 02 09:40:58 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f479fe5-568b-438a-96fe-07c82698f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5afbe52-3733-4b23-904e-36e237b403c4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501ca8d6-1699-4df6-ab62-b6042104d74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:58 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Volume volume-c5afbe52-3733-4b23-904e-36e237b403c4 (c5afbe52-3733-4b23-904e-36e237b403c4): created successfully Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501ca8d6-1699-4df6-ab62-b6042104d74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Flow 'volume_create_manager' (e30a1661-d943-4e88-9123-f9ca632904e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-71ea6595-b4e3-4a35-b5ef-a6bcd1b149fc tempest-VolumesTransfersTest-606493914 None] Created volume successfully. Nov 02 09:40:59 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 1073741824" returned: 0 in 0.490s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:40:59 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 Nov 02 09:40:59 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:40:59 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8" returned: 0 in 0.260s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61236f97-c7f9-4607-adb9-5babb8a891b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c69a388-e779-4044-8333-999d4a5f35d8', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623a60ea-3e0b-4281-9f31-c56141f0d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:40:59 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Volume volume-8c69a388-e779-4044-8333-999d4a5f35d8 (8c69a388-e779-4044-8333-999d4a5f35d8): created successfully Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623a60ea-3e0b-4281-9f31-c56141f0d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Flow 'volume_create_manager' (ba7e7cae-637c-4021-bff6-de5acb837544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:40:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cba0c392-3db7-46a3-b2f4-5c14ab70d7c8 tempest-ServersNegativeTestJSON-788018966 None] Created volume successfully. Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Acquiring lock "cinder-c5afbe52-3733-4b23-904e-36e237b403c4-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "cinder-c5afbe52-3733-4b23-904e-36e237b403c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:40:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Acquiring lock "cinder-quobyte-c5afbe52-3733-4b23-904e-36e237b403c4" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "cinder-quobyte-c5afbe52-3733-4b23-904e-36e237b403c4" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b0f8b-cf85-4639-8290-d307fbedb020]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:00 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 Nov 02 09:41:00 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "cinder-8c69a388-e779-4044-8333-999d4a5f35d8-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-8c69a388-e779-4044-8333-999d4a5f35d8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "cinder-quobyte-8c69a388-e779-4044-8333-999d4a5f35d8" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-quobyte-8c69a388-e779-4044-8333-999d4a5f35d8" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:00 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4" returned: 0 in 0.496s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790041c-fba1-4264-bd86-a71fa6e7bd37]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:00 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4 Nov 02 09:41:00 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:00 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 Nov 02 09:41:00 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:00 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c5afbe52-3733-4b23-904e-36e237b403c4" returned: 0 in 0.291s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "cinder-quobyte-c5afbe52-3733-4b23-904e-36e237b403c4" released by "delete_volume" :: held 0.841s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:00 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Created reservations ['f2b079a7-bca1-4ab9-9b2c-0011ecf4289b', 'a2912e24-0ae9-4234-a1a4-ed48f90b6a81', 'ae24660a-4014-4cee-a8b1-6571b89f8008', '934e7f60-2e54-494f-9660-e6dcdf2e394f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:01 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8" returned: 0 in 0.532s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:01 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:01 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:01 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8 Nov 02 09:41:01 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:01 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8c69a388-e779-4044-8333-999d4a5f35d8" returned: 0 in 0.332s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:01 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.367s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-quobyte-8c69a388-e779-4044-8333-999d4a5f35d8" released by "delete_volume" :: held 0.944s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Deleted volume successfully. Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0eb3e1d-5b9a-4d21-871f-214789d1aed5 tempest-VolumesTransfersTest-516180736 None] Lock "cinder-c5afbe52-3733-4b23-904e-36e237b403c4-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Created reservations ['83e28e6c-0b81-4fb4-ad3b-f4e2a74231b0', '12bccc8b-fd34-49c7-94da-18e004ab04ea', '98508328-483f-47d8-9b46-75f6cb84ca8f', '8c81dc10-18a8-4c68-aa53-20aec501c81c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:01 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:01 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:01 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.271s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Deleted volume successfully. Nov 02 09:41:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e353cab2-fe64-4c65-8bbe-302587eefbe5 tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-8c69a388-e779-4044-8333-999d4a5f35d8-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "cinder-3f611830-0832-412f-955c-6a1f7f118c09-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-3f611830-0832-412f-955c-6a1f7f118c09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "cinder-quobyte-3f611830-0832-412f-955c-6a1f7f118c09" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-quobyte-3f611830-0832-412f-955c-6a1f7f118c09" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55f431-3f74-4eb9-8a28-b3a0d6b2222d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:02 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 Nov 02 09:41:02 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:03 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09" returned: 0 in 0.385s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:03 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09 Nov 02 09:41:03 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:03 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3f611830-0832-412f-955c-6a1f7f118c09" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-quobyte-3f611830-0832-412f-955c-6a1f7f118c09" released by "delete_volume" :: held 0.747s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Created reservations ['4375a3c7-6cf1-4851-946c-bc59b0c26389', '6b5926e7-379c-405d-96d8-9aa831c3ebb8', 'f3f00dde-8fa8-454f-8944-00b24bb871a4', '921fb2f9-0ebb-408d-8e48-f9c4ef161385'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:03 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:03 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:04 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.326s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Deleted volume successfully. Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f7578a7-7ae8-4751-a461-0cadd74f91fb tempest-ServersNegativeTestJSON-788018966 None] Lock "cinder-3f611830-0832-412f-955c-6a1f7f118c09-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (6ec402cf-1a52-4e63-a5e6-0ae8b16d8bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c6f9e6-bec1-4b34-9ec8-98f9756788f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c6f9e6-bec1-4b34-9ec8-98f9756788f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1275626478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2e8a3f-6265-4690-af5a-c619b579f0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:05Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5c30c-553a-4eb1-8086-5833750832fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5c30c-553a-4eb1-8086-5833750832fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2318cdd1-be20-408b-9ead-5da91764fd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2318cdd1-be20-408b-9ead-5da91764fd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2e8a3f-6265-4690-af5a-c619b579f0a5', 'volume_name': 'volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049169ec-b665-4a55-b3ee-b5731da188b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049169ec-b665-4a55-b3ee-b5731da188b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4eafc0c-58e8-4bc2-9465-3c7e1ac7c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Volume ca2e8a3f-6265-4690-af5a-c619b579f0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5', 'volume_size': 1} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1275626478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2e8a3f-6265-4690-af5a-c619b579f0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:05Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Creating volume ca2e8a3f-6265-4690-af5a-c619b579f0a5 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:05 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:05 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 1073741824 Nov 02 09:41:05 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:05 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 1073741824" returned: 0 in 0.664s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:05 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 Nov 02 09:41:05 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:06 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5" returned: 0 in 0.329s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4eafc0c-58e8-4bc2-9465-3c7e1ac7c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ed2709-d4eb-45d3-b60b-725b71ececaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:06 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Volume volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 (ca2e8a3f-6265-4690-af5a-c619b579f0a5): created successfully Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ed2709-d4eb-45d3-b60b-725b71ececaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (6ec402cf-1a52-4e63-a5e6-0ae8b16d8bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8bcbbe02-0933-43af-819b-3049464aec86 tempest-VolumesListAdminTestJSON-1310738869 None] Created volume successfully. Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (05476515-fa95-4068-9847-a15a7ce251ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba4a3c-7adb-4281-8b19-c6c0183e178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba4a3c-7adb-4281-8b19-c6c0183e178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1815286960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0541fbc-4da1-4a01-b0ad-ad79a73998b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:08Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32a824b-6927-4c8b-9823-dc81893a1af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32a824b-6927-4c8b-9823-dc81893a1af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bf2604-41bd-4914-97ed-ec76c2215c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bf2604-41bd-4914-97ed-ec76c2215c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0541fbc-4da1-4a01-b0ad-ad79a73998b0', 'volume_name': 'volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2183e130-bb68-4f29-b31f-e14c4b9d8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2183e130-bb68-4f29-b31f-e14c4b9d8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24320fd8-9126-4244-814a-00cab8feda28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:07 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Volume b0541fbc-4da1-4a01-b0ad-ad79a73998b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0', 'volume_size': 1} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1815286960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0541fbc-4da1-4a01-b0ad-ad79a73998b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:08Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Creating volume b0541fbc-4da1-4a01-b0ad-ad79a73998b0 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:07 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:07 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 1073741824 Nov 02 09:41:07 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:08 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 1073741824" returned: 0 in 0.553s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:08 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 Nov 02 09:41:08 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:08 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" returned: 0 in 0.262s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24320fd8-9126-4244-814a-00cab8feda28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9196cd8f-9564-40e8-b6f2-744b3e83bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Volume volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 (b0541fbc-4da1-4a01-b0ad-ad79a73998b0): created successfully Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9196cd8f-9564-40e8-b6f2-744b3e83bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (05476515-fa95-4068-9847-a15a7ce251ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9110dacb-0afb-4290-a965-a39406b1a32f tempest-VolumesListAdminTestJSON-1310738869 None] Created volume successfully. Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (f5481ad5-7e6e-4d8c-80c8-0bc39a67c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec82984-96e0-47e6-9a9e-6f1c0e5872e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec82984-96e0-47e6-9a9e-6f1c0e5872e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1306511606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:10Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d1808-ba4e-4042-8d7c-97aff40409b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d1808-ba4e-4042-8d7c-97aff40409b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8216dbd-e50a-49dd-8dbc-e696118c15e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8216dbd-e50a-49dd-8dbc-e696118c15e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1', 'volume_name': 'volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cb231a-36d7-4057-aa0d-bfc955535d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cb231a-36d7-4057-aa0d-bfc955535d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa8706c-789a-4d00-8e85-e07b0835d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Volume 77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1', 'volume_size': 1} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1306511606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54eec9d7593845de8b0eacbf3ac64775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:10Z,use_quota=True,user_id='849e274ce19f4e65bea0594279231d29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Creating volume 77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:10 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:10 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 1073741824 Nov 02 09:41:10 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Flow 'volume_create_manager' (97818fe9-a21f-4c79-ac7a-cda359333b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4ccbf-046b-4d63-bd15-866b02df84d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4ccbf-046b-4d63-bd15-866b02df84d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-983910150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b8f559-fe63-4bbd-9d81-30391ac83493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1a5afef419448e968e121facb999d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:10Z,use_quota=True,user_id='96a2cc137bd14cf39121a2a79cea3f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8075fc-f86c-4515-a5a2-b860b384df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8075fc-f86c-4515-a5a2-b860b384df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bfcfdf-7173-4d78-ae64-e9cf17defe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04bfcfdf-7173-4d78-ae64-e9cf17defe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b8f559-fe63-4bbd-9d81-30391ac83493', 'volume_name': 'volume-65b8f559-fe63-4bbd-9d81-30391ac83493', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c17b180-0271-4cc7-b39c-46db81dee014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c17b180-0271-4cc7-b39c-46db81dee014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473c2a5d-a06b-4b21-9f01-3874fcc1c625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:10 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Volume 65b8f559-fe63-4bbd-9d81-30391ac83493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b8f559-fe63-4bbd-9d81-30391ac83493', 'volume_size': 1} Nov 02 09:41:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:11 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 1073741824" returned: 0 in 0.572s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-afeeedee-c8e2-406d-8923-e2459a4cb861 req-d097190f-3c5c-4936-bf41-0344a0c11c61 tempest-AttachVolumeTestJSON-971588719 None] Terminate volume connection completed successfully. Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-afeeedee-c8e2-406d-8923-e2459a4cb861 req-d097190f-3c5c-4936-bf41-0344a0c11c61 tempest-AttachVolumeTestJSON-971588719 None] Deleting attachment 3c455bfb-9091-49a6-bb62-aad620404498. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:11 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 Nov 02 09:41:11 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:11 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" returned: 0 in 0.318s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-983910150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b8f559-fe63-4bbd-9d81-30391ac83493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1a5afef419448e968e121facb999d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:10Z,use_quota=True,user_id='96a2cc137bd14cf39121a2a79cea3f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Creating volume 65b8f559-fe63-4bbd-9d81-30391ac83493 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:11 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa8706c-789a-4d00-8e85-e07b0835d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:11 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 1073741824 Nov 02 09:41:11 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d45940a-11a2-45bf-b3d3-a2ebe687a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Volume volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 (77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1): created successfully Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d45940a-11a2-45bf-b3d3-a2ebe687a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Flow 'volume_create_manager' (f5481ad5-7e6e-4d8c-80c8-0bc39a67c456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-eaaf2af1-4f04-4aa8-8e65-05ade16e8065 tempest-VolumesListAdminTestJSON-1310738869 None] Created volume successfully. Nov 02 09:41:12 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 1073741824" returned: 0 in 0.608s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:12 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 Nov 02 09:41:12 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:12 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493" returned: 0 in 0.398s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473c2a5d-a06b-4b21-9f01-3874fcc1c625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b8f559-fe63-4bbd-9d81-30391ac83493', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f04e7c-3e08-4818-a31b-73fc8328b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=67,cinder:INSERT=20,cinder:UPDATE=90,cinder:DELETE=8 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:41:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Volume volume-65b8f559-fe63-4bbd-9d81-30391ac83493 (65b8f559-fe63-4bbd-9d81-30391ac83493): created successfully Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f04e7c-3e08-4818-a31b-73fc8328b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Flow 'volume_create_manager' (97818fe9-a21f-4c79-ac7a-cda359333b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:12 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8393d276-62d4-4205-acb2-ba0432783a5c tempest-VolumesTransfersV357Test-211769572 None] Created volume successfully. Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Flow 'volume_create_manager' (7bb3ea3e-b265-4a1e-9a5e-db222fa10672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44fc353-1461-40bb-bc22-b52a363a03d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44fc353-1461-40bb-bc22-b52a363a03d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf7c4f8-9e17-4411-85cf-9767a4c37801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3f7e26993a4bdaaec15f3175bc13a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:14Z,use_quota=True,user_id='882844024b6a4919a0a9b04886e3cbd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c159a9-b628-487a-98c6-2d4861370e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c159a9-b628-487a-98c6-2d4861370e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecc0735-9801-4650-a6ab-050e89674d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecc0735-9801-4650-a6ab-050e89674d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf7c4f8-9e17-4411-85cf-9767a4c37801', 'volume_name': 'volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdf1943-e0a6-49b9-8193-0cb567fb05cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bdf1943-e0a6-49b9-8193-0cb567fb05cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358ed213-0eaa-45f5-94cd-5484646f5773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Volume bcf7c4f8-9e17-4411-85cf-9767a4c37801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801', 'volume_size': 1} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf7c4f8-9e17-4411-85cf-9767a4c37801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3f7e26993a4bdaaec15f3175bc13a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:14Z,use_quota=True,user_id='882844024b6a4919a0a9b04886e3cbd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Creating volume bcf7c4f8-9e17-4411-85cf-9767a4c37801 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:13 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:13 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 1073741824 Nov 02 09:41:13 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:14 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 1073741824" returned: 0 in 0.650s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:14 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 Nov 02 09:41:14 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:14 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801" returned: 0 in 0.438s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358ed213-0eaa-45f5-94cd-5484646f5773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41072ed-00fe-4889-ac2f-2661cf286aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:14 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Volume volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 (bcf7c4f8-9e17-4411-85cf-9767a4c37801): created successfully Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41072ed-00fe-4889-ac2f-2661cf286aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Flow 'volume_create_manager' (7bb3ea3e-b265-4a1e-9a5e-db222fa10672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:14 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-31e453bf-989b-4489-902d-367c56ab9f61 tempest-VolumesListAdminTestJSON-628145558 None] Created volume successfully. Nov 02 09:41:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ccd75763-7817-428d-acd4-fd2e6fde2d13 tempest-VolumesTransfersV357Test-61664126 None] Transfer volume completed successfully. Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Acquiring lock "cinder-bcf7c4f8-9e17-4411-85cf-9767a4c37801-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "cinder-bcf7c4f8-9e17-4411-85cf-9767a4c37801-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Acquiring lock "cinder-quobyte-bcf7c4f8-9e17-4411-85cf-9767a4c37801" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "cinder-quobyte-bcf7c4f8-9e17-4411-85cf-9767a4c37801" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fe3b62-f8e6-4b43-9359-453eacc7cc5a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-quobyte-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 Nov 02 09:41:16 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5567d19-e2f7-470e-ac9d-8abe652de473]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "cinder-65b8f559-fe63-4bbd-9d81-30391ac83493-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-65b8f559-fe63-4bbd-9d81-30391ac83493-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 Nov 02 09:41:16 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "cinder-quobyte-65b8f559-fe63-4bbd-9d81-30391ac83493" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-quobyte-65b8f559-fe63-4bbd-9d81-30391ac83493" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[189dcdfd-d219-457b-a467-d88b9b9432a7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:16 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801" returned: 0 in 0.698s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:17 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801 Nov 02 09:41:17 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:17 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 Nov 02 09:41:17 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:17 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" returned: 0 in 0.857s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:17 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1 Nov 02 09:41:17 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:17 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bcf7c4f8-9e17-4411-85cf-9767a4c37801" returned: 0 in 0.613s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "cinder-quobyte-bcf7c4f8-9e17-4411-85cf-9767a4c37801" released by "delete_volume" :: held 1.401s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Created reservations ['d6cfc477-1caf-44cc-9d78-2a8210a0fb7a', 'c0778e51-3ded-49c0-b659-399491b8043b', 'cdf0582e-6fad-4d19-af7a-639e4818965a', '07946763-b911-46bd-9b8a-8bb347143fe5'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:17 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493" returned: 0 in 1.066s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:17 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493 Nov 02 09:41:17 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:17 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" returned: 0 in 0.685s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1" released by "delete_volume" :: held 1.674s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:18 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:18 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Created reservations ['b0dac786-c331-4b4d-baaa-cceebfbfa5cc', 'e564d7bb-ee83-4ec1-bf9d-fa84150670d3', 'ea83f554-548f-4405-9bee-6b825a3bc1ea', '93f3acd0-d27a-49d5-b84a-9f75265e4cce'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:18 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-65b8f559-fe63-4bbd-9d81-30391ac83493" returned: 0 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-quobyte-65b8f559-fe63-4bbd-9d81-30391ac83493" released by "delete_volume" :: held 1.640s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Created reservations ['23620e99-38c7-4da4-875e-b41e4b3cddb1', '76cfa629-ced0-4a1c-acbd-be3b75b4545c', 'af64d30a-5013-4823-945f-a4224558bcb5', '90374681-9351-4fa5-b202-c79aa942e59d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:18 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:18 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:18 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.598s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Deleted volume successfully. Nov 02 09:41:18 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-b0541fbc-4da1-4a01-b0ad-ad79a73998b0-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.620s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1e7c6e1a-a802-4b38-ad44-472bb91ac429 tempest-VolumesListAdminTestJSON-628145558 None] Lock "cinder-bcf7c4f8-9e17-4411-85cf-9767a4c37801-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-b0541fbc-4da1-4a01-b0ad-ad79a73998b0-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Deleted volume successfully. Nov 02 09:41:19 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:19 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-748ce826-62ba-455d-8000-3d15f08bcde3 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-77a9d2c4-2e8c-4d5f-92c6-a67a419b9cb1-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Flow 'volume_create_manager' (466f1213-4fda-4255-8bed-80289b4edab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4415799-1ffe-4e8f-8bb5-bddf5467835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4415799-1ffe-4e8f-8bb5-bddf5467835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-222897791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c208b9-0c46-4ea7-bd45-12420c5093aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1bc89e9a502405884b5000bea6e04db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:19Z,use_quota=True,user_id='8035ea4234e243aa87a7b840f8ad421c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa41c8d-4962-40b0-a781-cc858fb4b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa41c8d-4962-40b0-a781-cc858fb4b690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f3274a-b15d-4f0b-9c73-a4af09d24240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f3274a-b15d-4f0b-9c73-a4af09d24240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c208b9-0c46-4ea7-bd45-12420c5093aa', 'volume_name': 'volume-72c208b9-0c46-4ea7-bd45-12420c5093aa', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32c814a-9c1f-49bd-b9b8-aae5b47883d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32c814a-9c1f-49bd-b9b8-aae5b47883d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f426e086-2214-41ee-ac7e-3ff4cfe434e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Volume 72c208b9-0c46-4ea7-bd45-12420c5093aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c208b9-0c46-4ea7-bd45-12420c5093aa', 'volume_size': 1} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-222897791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c208b9-0c46-4ea7-bd45-12420c5093aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1bc89e9a502405884b5000bea6e04db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:19Z,use_quota=True,user_id='8035ea4234e243aa87a7b840f8ad421c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Creating volume 72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:19 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-quobyte-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:19 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa 1073741824 Nov 02 09:41:19 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a27c79f-c5aa-4436-a4a6-3017f7490c06]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:19 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Deleted volume successfully. Nov 02 09:41:19 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 Nov 02 09:41:19 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1839c041-fea9-48a0-a87b-10636ad22f52 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-65b8f559-fe63-4bbd-9d81-30391ac83493-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:20 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa 1073741824" returned: 0 in 0.740s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:20 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" returned: 0 in 0.681s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:20 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0 Nov 02 09:41:20 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:20 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa Nov 02 09:41:20 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:20 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" returned: 0 in 0.403s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Flow 'volume_create_manager' (6bf4580f-ff3f-4f3a-af82-5e381ef24722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68e30ad-6dc4-48f3-9a5c-b23cab8d9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-b0541fbc-4da1-4a01-b0ad-ad79a73998b0" released by "delete_volume" :: held 1.213s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68e30ad-6dc4-48f3-9a5c-b23cab8d9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-271725636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8c3948-2999-4fab-aaa6-cfde33d4adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1a5afef419448e968e121facb999d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:20Z,use_quota=True,user_id='96a2cc137bd14cf39121a2a79cea3f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542ae71-2148-4752-bc64-3b5d53caed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c542ae71-2148-4752-bc64-3b5d53caed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165b602f-5e7c-46d4-9a1b-249f7e9efa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165b602f-5e7c-46d4-9a1b-249f7e9efa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8c3948-2999-4fab-aaa6-cfde33d4adec', 'volume_name': 'volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e680532f-eaa7-4837-954c-a32d3eaa4a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e680532f-eaa7-4837-954c-a32d3eaa4a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a398f0-20d7-400b-9c65-ab24a92a0564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Volume ab8c3948-2999-4fab-aaa6-cfde33d4adec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec', 'volume_size': 1} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa" returned: 0 in 0.509s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-271725636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8c3948-2999-4fab-aaa6-cfde33d4adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1a5afef419448e968e121facb999d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:20Z,use_quota=True,user_id='96a2cc137bd14cf39121a2a79cea3f29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Creating volume ab8c3948-2999-4fab-aaa6-cfde33d4adec {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:20 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:20 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec 1073741824 Nov 02 09:41:20 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f426e086-2214-41ee-ac7e-3ff4cfe434e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c208b9-0c46-4ea7-bd45-12420c5093aa', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095abf4-e001-45a6-9ae8-e24f3fc9c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Created reservations ['5e1d48ae-3e8c-42cd-8d8c-43cb4900a648', 'd45bfe6a-77e3-48f6-b7a4-6e22db77eae3', '18326f23-922d-425c-a7da-1d50f4d38e43', '013d7c8f-2433-4360-b39e-cc28a620db76'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Volume volume-72c208b9-0c46-4ea7-bd45-12420c5093aa (72c208b9-0c46-4ea7-bd45-12420c5093aa): created successfully Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a095abf4-e001-45a6-9ae8-e24f3fc9c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Flow 'volume_create_manager' (466f1213-4fda-4255-8bed-80289b4edab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:20 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-57dacfe7-d6d1-444b-971e-bff6851cdbba req-8ae46c19-92b4-49ee-b9e2-823584fcd0a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Created volume successfully. Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:20 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:20 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:21 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.322s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Deleted volume successfully. Nov 02 09:41:21 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec 1073741824" returned: 0 in 0.643s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-951bf183-28d5-4cfe-9776-6a84b57037b7 tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-b0541fbc-4da1-4a01-b0ad-ad79a73998b0-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:21 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec Nov 02 09:41:21 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-ca2e8a3f-6265-4690-af5a-c619b579f0a5-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-ca2e8a3f-6265-4690-af5a-c619b579f0a5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "cinder-quobyte-ca2e8a3f-6265-4690-af5a-c619b579f0a5" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-ca2e8a3f-6265-4690-af5a-c619b579f0a5" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd077fbe-a651-41f3-80ff-f4dbe633373b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:21 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.266s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Creating offline snapshot 4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb of volume 72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a398f0-20d7-400b-9c65-ab24a92a0564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba607356-5e71-4c17-a227-cae77edb1b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eeecfd-7ee3-4fa9-82a9-79b9b124e8b2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:21 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 Nov 02 09:41:21 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Volume volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec (ab8c3948-2999-4fab-aaa6-cfde33d4adec): created successfully Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba607356-5e71-4c17-a227-cae77edb1b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Flow 'volume_create_manager' (6bf4580f-ff3f-4f3a-af82-5e381ef24722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-39e0e059-f6bf-4f86-a172-30e9357b8939 tempest-VolumesTransfersV357Test-211769572 None] Created volume successfully. Nov 02 09:41:21 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa Nov 02 09:41:21 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:22 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:22 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5 Nov 02 09:41:22 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:22 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa" returned: 0 in 0.412s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:22 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb 1G Nov 02 09:41:22 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:22 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ca2e8a3f-6265-4690-af5a-c619b579f0a5" returned: 0 in 0.276s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-quobyte-ca2e8a3f-6265-4690-af5a-c619b579f0a5" released by "delete_volume" :: held 0.792s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Created reservations ['fba2b587-d63e-453a-8c43-71a8f750c5e0', '821080c7-b9fd-4d62-93d8-95a7b624eb55', 'd9554493-f2cb-4169-afb5-5ab07064d763', '2f7ad532-dc74-4146-91c4-21717916a044'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:22 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:22 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:22 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb 1G" returned: 0 in 0.606s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c208b9-0c46-4ea7-bd45-12420c5093aa -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:22 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c208b9-0c46-4ea7-bd45-12420c5093aa -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb Nov 02 09:41:22 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:22 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.441s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "cinder-ab8c3948-2999-4fab-aaa6-cfde33d4adec-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Deleted volume successfully. Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-ab8c3948-2999-4fab-aaa6-cfde33d4adec-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7cffe82b-e20e-4688-9b2f-b217fa08d93e tempest-VolumesListAdminTestJSON-1310738869 None] Lock "cinder-ca2e8a3f-6265-4690-af5a-c619b579f0a5-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "cinder-quobyte-ab8c3948-2999-4fab-aaa6-cfde33d4adec" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-quobyte-ab8c3948-2999-4fab-aaa6-cfde33d4adec" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c88c63-9150-4ed0-982e-604c9c63244f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:23 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72c208b9-0c46-4ea7-bd45-12420c5093aa -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" returned: 0 in 0.399s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:23 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb is being set with open permissions: ugo+rw Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:23 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb Nov 02 09:41:23 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:23 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec Nov 02 09:41:23 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:23 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:23 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info Nov 02 09:41:23 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:23 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec" returned: 0 in 0.454s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:23 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec Nov 02 09:41:23 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:23 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:23 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info is being set with open permissions: ugo+rw Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:23 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info Nov 02 09:41:23 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:23 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab8c3948-2999-4fab-aaa6-cfde33d4adec" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-quobyte-ab8c3948-2999-4fab-aaa6-cfde33d4adec" released by "delete_volume" :: held 0.849s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Created reservations ['47b522d0-cde3-4b4a-8165-022e5410059a', '997bb78e-b33d-4670-bad0-fd717dcbcfea', '65a69d2b-919b-4d3c-b3bb-8a2d1bdbc5f9', 'f61debbe-b3a1-467c-ba6a-ca20f0864186'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:24 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:24 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:24 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.info" returned: 0 in 0.383s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-e0efd9a2-1ee5-4169-a7a7-25ec48da63ee req-ff450ff7-c73a-450e-9a06-e07130a2066e tempest-VolumesSnapshotsTestJSON-876665093 None] Create snapshot completed successfully Nov 02 09:41:24 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.345s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Deleted volume successfully. Nov 02 09:41:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-105251f5-3098-4cf8-aabf-39e261e640c0 tempest-VolumesTransfersV357Test-754623068 None] Lock "cinder-ab8c3948-2999-4fab-aaa6-cfde33d4adec-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "cinder-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "cinder-quobyte-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Deleting offline snapshot 4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb of volume 72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] snapshot_file for this snap is: volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fbff44-32a0-4fd2-b92a-26c4d489646d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:25 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb Nov 02 09:41:25 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:25 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" returned: 0 in 0.459s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72c208b9-0c46-4ea7-bd45-12420c5093aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[515722e6-1c45-4ffa-840d-33b2a1d98977]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:25 devstack sudo[94928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa Nov 02 09:41:25 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:26 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa" returned: 0 in 0.545s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:26 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb Nov 02 09:41:26 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:26 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" returned: 0 in 0.543s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:26 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb Nov 02 09:41:26 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:27 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa.4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" returned: 0 in 0.363s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb" released by "_delete_snapshot" :: held 2.100s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" released by "delete_snapshot" :: held 2.156s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:27 devstack cinder-volume[86887]: WARNING cinder.quota [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:41:27 devstack cinder-volume[86887]: DEBUG cinder.quota [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Created reservations ['5963c149-0266-408b-8ec0-229ee87cebd3', '17c1fb4c-30c0-494f-af12-3e6f8fb1c664', '2add77d8-3615-4416-9599-8599088374e5', '1cfcd8f0-521e-46db-9b38-6aa30cccc769'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Delete snapshot completed successfully. Nov 02 09:41:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-aa0833a0-a17e-4bec-806e-c7edd206aa41 req-e6ceeb3b-c3cb-4f3c-881b-487281ef9285 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-4aceb586-d4a2-4ccf-97bb-9eafaaeac6fb-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "cinder-72c208b9-0c46-4ea7-bd45-12420c5093aa-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-72c208b9-0c46-4ea7-bd45-12420c5093aa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[985a27c0-0297-4225-bb8c-8f03476410c1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:28 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa Nov 02 09:41:28 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:29 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa" returned: 0 in 0.435s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:29 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa Nov 02 09:41:29 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:29 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-72c208b9-0c46-4ea7-bd45-12420c5093aa" returned: 0 in 0.299s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-quobyte-72c208b9-0c46-4ea7-bd45-12420c5093aa" released by "delete_volume" :: held 0.823s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG cinder.quota [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Created reservations ['a62d9305-f8ec-45b4-a2ed-2427014d41cc', '18654a45-0692-4ddb-8e48-0be7ace8a067', 'e4973a14-b485-41d4-a09a-f73349ec988a', '9cc6db80-11ee-48df-a4c0-dabeb796d86f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:29 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:29 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:29 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.manager [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Deleted volume successfully. Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-877dda47-199b-4d6b-8143-bd2c24e7ea49 req-68e66a23-033b-40c8-8ebf-8e746b0fd3a5 tempest-VolumesSnapshotsTestJSON-876665093 None] Lock "cinder-72c208b9-0c46-4ea7-bd45-12420c5093aa-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (ebdba387-4a73-466c-9fbe-973ec23cd180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e5c6e-7748-4335-87b2-5f5834f641de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7e5c6e-7748-4335-87b2-5f5834f641de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095975774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223f693e-515a-45d2-9297-5ff3a7ef7f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53df3363b4be4fb491701c4e0dad7374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:31Z,use_quota=True,user_id='c13ab4f29bb04d6c8e3ec15e36819cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1148045b-38c7-4669-b777-1ff0d38d7495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1148045b-38c7-4669-b777-1ff0d38d7495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6d4dbd-42d4-4417-b249-5769d2f921a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6d4dbd-42d4-4417-b249-5769d2f921a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223f693e-515a-45d2-9297-5ff3a7ef7f9f', 'volume_name': 'volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ae7a31-5f7e-47e0-baef-2cac83d9b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ae7a31-5f7e-47e0-baef-2cac83d9b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce56707-be42-494d-a0cb-a3ac8291a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:30 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f', 'volume_size': 1} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1095975774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223f693e-515a-45d2-9297-5ff3a7ef7f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53df3363b4be4fb491701c4e0dad7374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:31Z,use_quota=True,user_id='c13ab4f29bb04d6c8e3ec15e36819cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Creating volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:30 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:30 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f 1073741824 Nov 02 09:41:30 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:31 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f 1073741824" returned: 0 in 0.588s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:31 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:31 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:31 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce56707-be42-494d-a0cb-a3ac8291a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a06c299-172a-4547-aebb-12b8275a7ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:31 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Volume volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f (223f693e-515a-45d2-9297-5ff3a7ef7f9f): created successfully Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a06c299-172a-4547-aebb-12b8275a7ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (ebdba387-4a73-466c-9fbe-973ec23cd180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-92fe39fb-0fb7-402b-b077-dcb1e3c061f6 tempest-VolumesDeleteCascade-318922578 None] Created volume successfully. Nov 02 09:41:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Creating offline snapshot bd733668-2033-4dc3-96c4-e8e10d5a95db of volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:41:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc763b98-1b7f-43c9-afbd-0583b077389c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:33 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:33 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (9bbf3d34-c95c-440a-b648-fe269db6f391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b564c6d5-5d74-4fb2-8791-1a93aa68e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b564c6d5-5d74-4fb2-8791-1a93aa68e623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1852931393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bcc3aa-e1b8-451c-aee5-1da67ad5dc64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:33Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a0506e-e986-437f-b094-33a391e5239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a0506e-e986-437f-b094-33a391e5239a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c12ae-4cb8-44d2-858f-045d25abc082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c12ae-4cb8-44d2-858f-045d25abc082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bcc3aa-e1b8-451c-aee5-1da67ad5dc64', 'volume_name': 'volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd4116d-7599-4af6-b04e-6d9c091c5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd4116d-7599-4af6-b04e-6d9c091c5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd2b57-6fdb-4069-b213-987aa4b7837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:33 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Volume 34bcc3aa-e1b8-451c-aee5-1da67ad5dc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64', 'volume_size': 1} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:33 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.399s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:33 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db 1G Nov 02 09:41:33 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:33 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db 1G" returned: 0 in 0.422s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:33 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:33 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:34 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.306s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:34 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db is being set with open permissions: ugo+rw Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:34 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:34 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:34 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.262s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:34 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info Nov 02 09:41:34 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:34 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info" returned: 0 in 0.242s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:34 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info is being set with open permissions: ugo+rw Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:34 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info Nov 02 09:41:34 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:34 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.info" returned: 0 in 0.247s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1852931393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bcc3aa-e1b8-451c-aee5-1da67ad5dc64,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:33Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Creating volume 34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:34 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:34 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 1073741824 Nov 02 09:41:34 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-acf04780-e694-46a3-b918-f020ab8641d1 tempest-VolumesDeleteCascade-318922578 None] Create snapshot completed successfully Nov 02 09:41:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f93b0b39-0dc9-42ab-b70a-3e662ac8a2b2 tempest-GroupsV320Test-589826524 None] Group tempest-GroupsV320Test-Group-640297842: creating Nov 02 09:41:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f93b0b39-0dc9-42ab-b70a-3e662ac8a2b2 tempest-GroupsV320Test-589826524 None] Group tempest-GroupsV320Test-Group-640297842: created successfully Nov 02 09:41:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f93b0b39-0dc9-42ab-b70a-3e662ac8a2b2 tempest-GroupsV320Test-589826524 None] Create group completed successfully. Nov 02 09:41:35 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 1073741824" returned: 0 in 0.465s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:35 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 Nov 02 09:41:35 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:35 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" returned: 0 in 0.244s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cd2b57-6fdb-4069-b213-987aa4b7837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86768d-241a-41c1-97c1-fe4ff02d9f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:35 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Volume volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 (34bcc3aa-e1b8-451c-aee5-1da67ad5dc64): created successfully Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a86768d-241a-41c1-97c1-fe4ff02d9f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (9bbf3d34-c95c-440a-b648-fe269db6f391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-17187e7d-dbd3-497c-a8fd-91edf19b860c tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Creating offline snapshot fb21a648-df10-468d-a239-c43d6ec3682d of volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ee61e-f2eb-4d75-a60a-1f8dda87e38a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:36 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:36 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:36 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:36 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d 1G Nov 02 09:41:36 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Created reservations ['aec32a55-53ea-4dcb-8796-409977a045c7'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:36 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:36 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:37 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fd66d4a3-29a0-4cab-9f7e-ef0688af1a99 tempest-GroupsV320Test-589826524 None] Delete group completed successfully. Nov 02 09:41:37 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d 1G" returned: 0 in 0.545s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:37 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:37 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (7a7e575e-d0ab-4c67-9d9e-5d2f89f96dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fe2ddf-8bd2-4b59-aaf7-a7c31f8a30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fe2ddf-8bd2-4b59-aaf7-a7c31f8a30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-398657984',display_name='tempest-VolumesGetTest-Volume-1425764692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cc2939-1f5a-48fa-acce-4ca6256f61ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:37Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d145498-9f4b-4d1f-ad87-e8cb2dcd42ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d145498-9f4b-4d1f-ad87-e8cb2dcd42ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342dd9d0-e1a2-4cb4-b21d-3af23e339129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (342dd9d0-e1a2-4cb4-b21d-3af23e339129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cc2939-1f5a-48fa-acce-4ca6256f61ed', 'volume_name': 'volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0845d-5a28-4504-8fbe-1e7a5719a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e0845d-5a28-4504-8fbe-1e7a5719a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c6194-01a2-4dac-9389-d78df3863dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Volume 06cc2939-1f5a-48fa-acce-4ca6256f61ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed', 'volume_size': 1} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:37 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:37 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d is being set with open permissions: ugo+rw Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:37 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:37 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:37 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.246s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.633s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.444s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-398657984',display_name='tempest-VolumesGetTest-Volume-1425764692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cc2939-1f5a-48fa-acce-4ca6256f61ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:37Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Creating volume 06cc2939-1f5a-48fa-acce-4ca6256f61ed {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:37 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:37 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed 1073741824 Nov 02 09:41:37 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fc2131d8-23c7-420b-b033-02aa38f29e32 tempest-VolumesDeleteCascade-318922578 None] Create snapshot completed successfully Nov 02 09:41:38 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed 1073741824" returned: 0 in 0.494s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-223f693e-515a-45d2-9297-5ff3a7ef7f9f-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-223f693e-515a-45d2-9297-5ff3a7ef7f9f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:38 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed Nov 02 09:41:38 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Performing cascade delete. {{(pid=86887) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-bd733668-2033-4dc3-96c4-e8e10d5a95db-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-bd733668-2033-4dc3-96c4-e8e10d5a95db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-bd733668-2033-4dc3-96c4-e8e10d5a95db" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-bd733668-2033-4dc3-96c4-e8e10d5a95db" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Deleting offline snapshot bd733668-2033-4dc3-96c4-e8e10d5a95db of volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] snapshot_file for this snap is: volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d64769-a043-4098-84f8-8e8ccd36692b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:38 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:38 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:38 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c6194-01a2-4dac-9389-d78df3863dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b75bdc-0471-4c66-bc2a-a397565fac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:38 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Volume volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed (06cc2939-1f5a-48fa-acce-4ca6256f61ed): created successfully Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b75bdc-0471-4c66-bc2a-a397565fac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (7a7e575e-d0ab-4c67-9d9e-5d2f89f96dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-64b79e3b-fc08-40e5-96ad-a5e3c7f9105a tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:41:39 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.423s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[69010a27-92f4-45c1-9664-b4d73ba5c0a1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:39 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:39 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:39 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.514s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a55159-d386-4371-8e2a-ed140a3a8019]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-06cc2939-1f5a-48fa-acce-4ca6256f61ed-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-06cc2939-1f5a-48fa-acce-4ca6256f61ed-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-06cc2939-1f5a-48fa-acce-4ca6256f61ed" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:39 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:39 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-06cc2939-1f5a-48fa-acce-4ca6256f61ed" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[07119d55-b49a-48e8-af32-a52dfc9fea2d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:40 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed Nov 02 09:41:40 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:40 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.573s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d6985-96af-4fec-8bc1-c8f711bdb19f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:40 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:40 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:40 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed" returned: 0 in 0.573s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:40 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed Nov 02 09:41:40 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:40 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.520s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf5ff6-02bf-48e1-b32a-6a642132506b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:40 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-06cc2939-1f5a-48fa-acce-4ca6256f61ed" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-06cc2939-1f5a-48fa-acce-4ca6256f61ed" released by "delete_volume" :: held 1.008s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Created reservations ['33f78f37-122b-48c1-95e6-a0d536a1b8c0', 'cb50a6d5-cede-40f9-8384-605a365a1339', 'cf21eba3-5705-4580-9bbe-ce103180bf55', 'b5b87881-188a-4234-b4f4-70d8713099a4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:41 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:41 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:41 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:41 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:41 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.417s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:41 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.761s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-782ae8b1-e802-4bc1-8571-5391ec7298e6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-06cc2939-1f5a-48fa-acce-4ca6256f61ed-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:41 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:41 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:42 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.558s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:42 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db Nov 02 09:41:42 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "cinder-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa851d0-c76a-466f-987c-734e57cf6cd2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:42 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.bd733668-2033-4dc3-96c4-e8e10d5a95db" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d -F qcow2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:42 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 Nov 02 09:41:42 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:42 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d -F qcow2 Nov 02 09:41:42 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:42 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:42 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d -F qcow2" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" returned: 0 in 0.576s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-bd733668-2033-4dc3-96c4-e8e10d5a95db" released by "_delete_snapshot" :: held 4.480s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" released by "delete_snapshot" :: held 4.510s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:43 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64 Nov 02 09:41:43 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Created reservations ['8bf6d8e2-8bc2-410b-8006-f5a630cbc79b', 'a75cbab8-2675-4a6b-b3d1-130930a6d9f5', '169e07c9-a80a-41b5-b39a-c96241923142', '9ae132b8-ed3b-4dc3-b044-ac521af3dbbb'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Delete snapshot completed successfully. Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-bd733668-2033-4dc3-96c4-e8e10d5a95db-delete_snapshot" released by "delete_snapshot" :: held 4.744s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-fb21a648-df10-468d-a239-c43d6ec3682d-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-fb21a648-df10-468d-a239-c43d6ec3682d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-fb21a648-df10-468d-a239-c43d6ec3682d" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-fb21a648-df10-468d-a239-c43d6ec3682d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Deleting offline snapshot fb21a648-df10-468d-a239-c43d6ec3682d of volume 223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] snapshot_file for this snap is: volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:41:43 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162748d-6cbb-4855-bbf9-bc8c0b6c4d07]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" returned: 0 in 0.410s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64" released by "delete_volume" :: held 1.074s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Created reservations ['9df11f90-a787-4a28-becd-1f78450816db', '2f0de187-6dc8-48c9-99e8-6afea25065ec', '75d970bb-6c61-4c44-83ea-9986b07d5425', '3b00efd7-917a-4a7e-94eb-5ee21796874e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:43 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:43 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:43 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:43 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:43 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.514s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:43 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:43 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[348f3cb2-4e55-4621-a0d5-40017e4f358a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f3e7349f-a425-4f41-a5fe-976073201afa tempest-VolumesGetTest-2144186329 None] Lock "cinder-34bcc3aa-e1b8-451c-aee5-1da67ad5dc64-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:44 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:44 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:44 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.406s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:44 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:44 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:44 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:44 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d Nov 02 09:41:44 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:45 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f.fb21a648-df10-468d-a239-c43d6ec3682d" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (31a56373-4fc7-413d-98cb-0a8c0cd99bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2939fca0-c4c2-4411-ae9c-37010f040415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-fb21a648-df10-468d-a239-c43d6ec3682d" released by "_delete_snapshot" :: held 1.852s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" released by "delete_snapshot" :: held 1.892s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2939fca0-c4c2-4411-ae9c-37010f040415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-878482851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68ce30b-2296-4077-8871-033323358e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:45Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f92710-1269-4170-948b-64992ce7067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f92710-1269-4170-948b-64992ce7067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175da67d-c698-42ab-8187-5eee25a4caad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175da67d-c698-42ab-8187-5eee25a4caad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68ce30b-2296-4077-8871-033323358e74', 'volume_name': 'volume-f68ce30b-2296-4077-8871-033323358e74', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77611490-8a75-4abc-8b9c-bd7c6efc93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77611490-8a75-4abc-8b9c-bd7c6efc93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f292655-b4a6-4f0b-8355-32cdfacc405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Volume f68ce30b-2296-4077-8871-033323358e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68ce30b-2296-4077-8871-033323358e74', 'volume_size': 1} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-878482851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68ce30b-2296-4077-8871-033323358e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:45Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Creating volume f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:45 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 1073741824 Nov 02 09:41:45 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Created reservations ['d3ac3dc9-fc67-4a49-9e45-b0fa5f22c1b2', '33481253-fd9a-4b4e-a9f3-92fcf7c84840', '0d720667-41fa-4786-8b79-cc2b98f41122', 'bc668d98-7462-45fc-8668-5917f33a1c4f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Delete snapshot completed successfully. Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-fb21a648-df10-468d-a239-c43d6ec3682d-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Snapshots deleted, issuing volume delete {{(pid=86887) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[258fa2b2-74d6-4824-983a-5a3174130187]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:45 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:45 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:45 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 1073741824" returned: 0 in 0.660s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=159,cinder:SELECT=131,cinder:INSERT=48,cinder:DELETE=18 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:41:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:46 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:41:46 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Flow 'volume_create_manager' (5fc45d76-be45-4201-b285-c5999b62346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb21557-7505-4418-a3e8-12f51c111319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb21557-7505-4418-a3e8-12f51c111319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-580716118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d055cd4-8e65-492f-b1fb-4738bfbe7249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024368ffcbb4ecca2edf1c4eea7a203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:46Z,use_quota=True,user_id='dcc027025c4c4ffca95dc1657b4491fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0526bf-0353-48ed-aff7-2fdd8ea8f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0526bf-0353-48ed-aff7-2fdd8ea8f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c332cd-2f6b-4aac-833d-64fc4ec10937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c332cd-2f6b-4aac-833d-64fc4ec10937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d055cd4-8e65-492f-b1fb-4738bfbe7249', 'volume_name': 'volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823325c4-55e6-4326-9250-ae836b63680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823325c4-55e6-4326-9250-ae836b63680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc3a27d-11ce-4680-9222-c001e51a9f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249', 'volume_size': 1} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.547s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:46 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f Nov 02 09:41:46 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:46 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.328s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.188s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-580716118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d055cd4-8e65-492f-b1fb-4738bfbe7249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f024368ffcbb4ecca2edf1c4eea7a203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:46Z,use_quota=True,user_id='dcc027025c4c4ffca95dc1657b4491fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Creating volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:41:46 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f292655-b4a6-4f0b-8355-32cdfacc405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68ce30b-2296-4077-8871-033323358e74', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 1073741824 Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b247681-0fb5-4361-bca5-130ecd12c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:46 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Volume volume-f68ce30b-2296-4077-8871-033323358e74 (f68ce30b-2296-4077-8871-033323358e74): created successfully Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b247681-0fb5-4361-bca5-130ecd12c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (31a56373-4fc7-413d-98cb-0a8c0cd99bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:46 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-223f693e-515a-45d2-9297-5ff3a7ef7f9f" returned: 0 in 0.287s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-99220e0d-455a-4f05-9faa-0eabd4b001ca tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-223f693e-515a-45d2-9297-5ff3a7ef7f9f" released by "delete_volume" :: held 0.938s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Created reservations ['288d5111-e2f0-4850-a342-bb5412cac505', 'f52c5464-c77e-4e4a-a6fd-28199934df4b', '18b399d6-ab96-4d10-a7c6-0da4a5768ee8', 'ea93ac45-51af-42ed-bdbc-554ec3f0486f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:46 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:46 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:46 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 1073741824" returned: 0 in 0.563s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:46 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.316s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Deleted volume successfully. Nov 02 09:41:46 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 Nov 02 09:41:46 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d95b5185-d76f-4c4c-816c-27418f1675c9 tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-223f693e-515a-45d2-9297-5ff3a7ef7f9f-delete_volume" released by "delete_volume" :: held 8.594s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:41:47 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc3a27d-11ce-4680-9222-c001e51a9f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d6691d-6b31-49eb-be21-dd0185bc71c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Volume volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 (3d055cd4-8e65-492f-b1fb-4738bfbe7249): created successfully Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d6691d-6b31-49eb-be21-dd0185bc71c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Flow 'volume_create_manager' (5fc45d76-be45-4201-b285-c5999b62346d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b85bf2d5-f17c-4cf3-ba03-387f24f169aa tempest-SnapshotsActionsTest-1329503785 None] Created volume successfully. Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (43b88a14-8320-4838-a034-830f7acdf0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d0c591-55ec-4537-bf0b-6a15bc88fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d0c591-55ec-4537-bf0b-6a15bc88fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-737676289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99ac1e04-1a89-4eee-810e-ef06dc27706b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f68ce30b-2296-4077-8871-033323358e74,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:48Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173564b-b65e-4405-80a4-b9bc1ef36699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0173564b-b65e-4405-80a4-b9bc1ef36699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398898af-544b-4d26-a43b-2f2195fadef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (398898af-544b-4d26-a43b-2f2195fadef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '99ac1e04-1a89-4eee-810e-ef06dc27706b', 'volume_name': 'volume-99ac1e04-1a89-4eee-810e-ef06dc27706b', 'volume_size': 1, 'source_volid': 'f68ce30b-2296-4077-8871-033323358e74', 'source_volstatus': 'available'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f090a55-ddef-4ace-8375-d5be8ae786e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f090a55-ddef-4ace-8375-d5be8ae786e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a4ef7f-c0de-4a20-a88f-dcc1807ca16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Volume 99ac1e04-1a89-4eee-810e-ef06dc27706b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-99ac1e04-1a89-4eee-810e-ef06dc27706b', 'volume_size': 1, 'source_volid': 'f68ce30b-2296-4077-8871-033323358e74', 'source_volstatus': 'available'} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:48 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Cloning volume f68ce30b-2296-4077-8871-033323358e74 to volume 99ac1e04-1a89-4eee-810e-ef06dc27706b Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Creating offline snapshot 7b1d6c5c-665b-4e6b-b332-7f18138896dc of volume f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a31bb97-17b5-454c-9e8f-88319fb14e31]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:48 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:41:48 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (b7ddc4f8-294b-4371-9e8e-498b0e8a536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b84be-cdba-4dbc-906d-c5d147135ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b84be-cdba-4dbc-906d-c5d147135ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-597806012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53df3363b4be4fb491701c4e0dad7374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:48Z,use_quota=True,user_id='c13ab4f29bb04d6c8e3ec15e36819cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ca2b0-7bf4-47bc-8c76-55300bfbce7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16ca2b0-7bf4-47bc-8c76-55300bfbce7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4d296f-27c9-46ab-ac7b-440611add020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4d296f-27c9-46ab-ac7b-440611add020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75', 'volume_name': 'volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a7788-81bb-4c5d-ab17-efd544bb4b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a7788-81bb-4c5d-ab17-efd544bb4b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29425579-51a1-4c9d-8acb-6bad8749d9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:41:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Volume 7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75', 'volume_size': 1} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:48 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.432s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:48 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc 1G Nov 02 09:41:48 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:48 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc 1G" returned: 0 in 0.444s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68ce30b-2296-4077-8871-033323358e74 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:49 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68ce30b-2296-4077-8871-033323358e74 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:41:49 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:49 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f68ce30b-2296-4077-8871-033323358e74 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.321s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:49 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc is being set with open permissions: ugo+rw Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:49 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:41:49 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:49 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.250s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:49 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info Nov 02 09:41:49 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:49 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info" returned: 0 in 0.279s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:49 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info is being set with open permissions: ugo+rw Nov 02 09:41:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:49 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info Nov 02 09:41:49 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:50 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.info" returned: 0 in 0.253s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] snapshot: 7b1d6c5c-665b-4e6b-b332-7f18138896dc, volume: 99ac1e04-1a89-4eee-810e-ef06dc27706b, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d90765-4405-4db7-bb19-1c9198e299a8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:50 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:41:50 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:50 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.409s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f68ce30b-2296-4077-8871-033323358e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec9ad0-0462-41ab-8a03-9a774075405a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:41:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:50 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:41:50 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:51 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:41:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:41:51 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:41:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:51 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b Nov 02 09:41:51 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:41:58 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:41:58 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:41:58 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.515s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:41:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:41:59 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:41:59 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=107,cinder:UPDATE=147,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:42:00 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b" returned: 0 in 9.235s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:42:00 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Converted 1024.00 MB image at 110.86 MB/s Nov 02 09:42:00 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b is being set with open permissions: ugo+rw Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:00 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b Nov 02 09:42:00 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:00 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b" returned: 0 in 0.332s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" released by "_copy_volume_from_snapshot" :: held 10.535s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-7b1d6c5c-665b-4e6b-b332-7f18138896dc" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-7b1d6c5c-665b-4e6b-b332-7f18138896dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Deleting offline snapshot 7b1d6c5c-665b-4e6b-b332-7f18138896dc of volume f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] snapshot_file for this snap is: volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfd4d5-057f-429c-a989-948f9d4dfeff]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:00 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:42:00 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:01 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.384s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f68ce30b-2296-4077-8871-033323358e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b01db7-1bda-4cf3-8dc9-1395a3b71a2b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:01 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:42:01 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:01 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.526s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:01 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:42:01 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:02 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:02 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc Nov 02 09:42:02 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:02 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74.7b1d6c5c-665b-4e6b-b332-7f18138896dc" returned: 0 in 0.248s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-7b1d6c5c-665b-4e6b-b332-7f18138896dc" released by "_delete_snapshot" :: held 1.618s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.371s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.945s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-597806012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53df3363b4be4fb491701c4e0dad7374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:41:48Z,use_quota=True,user_id='c13ab4f29bb04d6c8e3ec15e36819cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Creating volume 7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:02 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:02 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 1073741824 Nov 02 09:42:02 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a4ef7f-c0de-4a20-a88f-dcc1807ca16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99ac1e04-1a89-4eee-810e-ef06dc27706b', 'volume_size': 1, 'source_volid': 'f68ce30b-2296-4077-8871-033323358e74', 'source_volstatus': 'available'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fe2590-bf6b-4fa6-8a86-d023269e4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Volume volume-99ac1e04-1a89-4eee-810e-ef06dc27706b (99ac1e04-1a89-4eee-810e-ef06dc27706b): created successfully Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fe2590-bf6b-4fa6-8a86-d023269e4c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (43b88a14-8320-4838-a034-830f7acdf0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8fd6e0be-bf79-44fc-b755-ced52ec5559e tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:42:02 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 1073741824" returned: 0 in 0.471s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:02 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:02 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:03 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.247s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.732s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29425579-51a1-4c9d-8acb-6bad8749d9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ea7a44-601a-4dd9-a050-b7bed5e10de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Creating offline snapshot fbd8e5e6-e86a-4fd3-a154-cb105de20afb of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:03 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Volume volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 (7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75): created successfully Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ea7a44-601a-4dd9-a050-b7bed5e10de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (b7ddc4f8-294b-4371-9e8e-498b0e8a536e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d542cc2-3b3c-45b6-8654-d55fd0aab8eb]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b56aa00c-9ff6-46f3-8775-36bfe0930c8e tempest-VolumesDeleteCascade-318922578 None] Created volume successfully. Nov 02 09:42:03 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 Nov 02 09:42:03 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:03 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249" returned: 0 in 0.436s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:03 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb 1G Nov 02 09:42:03 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:04 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb 1G" returned: 0 in 0.592s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:04 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:04 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (bb702c86-ee4c-486c-84d4-38ca86df6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bb4c96-749c-4991-ba07-21c4daf8e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bb4c96-749c-4991-ba07-21c4daf8e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-120065006',display_name='tempest-VolumesGetTest-Volume-1154538808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d47d7-e24c-4ead-8ef0-21d59fcbff14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:04Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c34890d-e0be-412f-ae95-cdd2443f101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c34890d-e0be-412f-ae95-cdd2443f101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c1439c-265e-44b0-a5af-0bdda6720846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c1439c-265e-44b0-a5af-0bdda6720846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81d47d7-e24c-4ead-8ef0-21d59fcbff14', 'volume_name': 'volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132a8ed1-7640-4330-a9b2-ec11249a752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132a8ed1-7640-4330-a9b2-ec11249a752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f5bf76-5f5e-4825-8a02-78ca52c7de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:04 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Volume f81d47d7-e24c-4ead-8ef0-21d59fcbff14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14', 'volume_size': 1} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:04 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:04 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb is being set with open permissions: ugo+rw Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:04 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:04 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:04 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.234s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:04 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info Nov 02 09:42:04 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:05 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info" returned: 0 in 0.249s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:05 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info is being set with open permissions: ugo+rw Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:05 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info Nov 02 09:42:05 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:05 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.info" returned: 0 in 0.276s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.439s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Creating offline snapshot 5864ef8e-2f73-457f-a2c3-f70e96781075 of volume 7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0a9c5278-422e-4a65-ba80-ba8d5ac07865 tempest-SnapshotsActionsTest-1329503785 None] Create snapshot completed successfully Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ea552-fe1f-4d21-b8be-cff1bd74139b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:05 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:05 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:05 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.365s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:05 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 1G Nov 02 09:42:05 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:06 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 1G" returned: 0 in 0.373s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:06 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:06 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:06 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.331s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:06 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 is being set with open permissions: ugo+rw Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:06 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:06 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:06 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.262s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:06 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info Nov 02 09:42:06 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:07 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:07 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info is being set with open permissions: ugo+rw Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:07 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info Nov 02 09:42:07 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:07 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.info" returned: 0 in 0.240s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-120065006',display_name='tempest-VolumesGetTest-Volume-1154538808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d47d7-e24c-4ead-8ef0-21d59fcbff14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:04Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Creating volume f81d47d7-e24c-4ead-8ef0-21d59fcbff14 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:07 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:07 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 1073741824 Nov 02 09:42:07 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0c9c47be-9cca-447c-adb0-61948360c046 tempest-VolumesDeleteCascade-318922578 None] Create snapshot completed successfully Nov 02 09:42:07 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 1073741824" returned: 0 in 0.426s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:07 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 Nov 02 09:42:07 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:08 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" returned: 0 in 0.267s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.189s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35f5bf76-5f5e-4825-8a02-78ca52c7de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e16fbf6-e85c-4ae1-84c1-3c55886abcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Creating offline snapshot 605aafa3-96e2-411b-b569-9314e18df709 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c52148-c845-4514-9697-7e9d4f76d3ba]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Volume volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 (f81d47d7-e24c-4ead-8ef0-21d59fcbff14): created successfully Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e16fbf6-e85c-4ae1-84c1-3c55886abcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (bb702c86-ee4c-486c-84d4-38ca86df6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8e7bd718-fb25-49db-88a5-f004c4bc78cc tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:42:08 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:08 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:08 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.494s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:08 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 1G Nov 02 09:42:08 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (1df00eb6-bc15-4e12-ae85-fba109f4ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66799cff-608f-49ca-97b8-941ae41a430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-f81d47d7-e24c-4ead-8ef0-21d59fcbff14-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66799cff-608f-49ca-97b8-941ae41a430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-205037861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979933d9-4e4b-4b8d-9f77-ddfc92bad9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53df3363b4be4fb491701c4e0dad7374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5864ef8e-2f73-457f-a2c3-f70e96781075,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:09Z,use_quota=True,user_id='c13ab4f29bb04d6c8e3ec15e36819cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9358280e-6d07-4f99-83a2-4a1d473b5457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9358280e-6d07-4f99-83a2-4a1d473b5457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8642c78-9cba-4cd3-8f04-15ced76709ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8642c78-9cba-4cd3-8f04-15ced76709ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '979933d9-4e4b-4b8d-9f77-ddfc92bad9f1', 'volume_name': 'volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1', 'volume_size': 1, 'snapshot_id': '5864ef8e-2f73-457f-a2c3-f70e96781075'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede84566-0c21-48e2-92af-91ac5046e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ede84566-0c21-48e2-92af-91ac5046e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9253395-5bd1-4085-a718-905c431e92aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:09 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Volume 979933d9-4e4b-4b8d-9f77-ddfc92bad9f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1', 'volume_size': 1, 'snapshot_id': '5864ef8e-2f73-457f-a2c3-f70e96781075'} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "cinder-f81d47d7-e24c-4ead-8ef0-21d59fcbff14-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a040ae97-c119-42e7-97c2-a0fc5a2e95ba]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:09 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 Nov 02 09:42:09 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:09 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 1G" returned: 0 in 0.596s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:09 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 Nov 02 09:42:09 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:09 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" returned: 0 in 0.396s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:09 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14 Nov 02 09:42:09 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:09 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:09 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 is being set with open permissions: ugo+rw Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:09 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 Nov 02 09:42:09 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:09 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" returned: 0 in 0.288s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-f81d47d7-e24c-4ead-8ef0-21d59fcbff14" released by "delete_volume" :: held 0.743s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Created reservations ['571cd45b-41e0-4fff-8788-6584467386c8', 'e8292c1a-5529-476a-8df4-34abb52f69f7', 'c18d4340-6d14-4d65-acbf-dbac19640abe', '83abf3fe-0fc3-4e94-9214-76348a4a1e80'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:09 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709" returned: 0 in 0.287s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.940s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-417ef1da-fafa-4203-9d81-b03586f150a9 tempest-SnapshotsActionsTest-1329503785 None] Create snapshot completed successfully Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Creating volume 979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 from snapshot 5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:10 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] snapshot: 5864ef8e-2f73-457f-a2c3-f70e96781075, volume: 979933d9-4e4b-4b8d-9f77-ddfc92bad9f1, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-99ac1e04-1a89-4eee-810e-ef06dc27706b-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ea88f-79f1-4197-942e-ee5559e4a959]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-605aafa3-96e2-411b-b569-9314e18df709-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-99ac1e04-1a89-4eee-810e-ef06dc27706b-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-605aafa3-96e2-411b-b569-9314e18df709-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-605aafa3-96e2-411b-b569-9314e18df709" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-605aafa3-96e2-411b-b569-9314e18df709" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Deleting offline snapshot 605aafa3-96e2-411b-b569-9314e18df709 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:10 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] snapshot_file for this snap is: volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.400s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:10 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:10 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c5679-53cb-4537-9d3b-6e8882446b4a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560fe66-132a-493e-9865-c80680e408d8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b9b6a50e-506a-457a-ae83-b05d173befe5 tempest-VolumesGetTest-2144186329 None] Lock "cinder-f81d47d7-e24c-4ead-8ef0-21d59fcbff14-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:10 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 Nov 02 09:42:10 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b Nov 02 09:42:10 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.492s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e73f26e-74c4-47ae-b4d2-544d311ea0d2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:10 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709" returned: 0 in 0.422s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:10 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b Nov 02 09:42:10 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:10 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed57d9-60fa-4e5b-8569-64877d16c11b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:11 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:11 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:11 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99ac1e04-1a89-4eee-810e-ef06dc27706b" returned: 0 in 0.263s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-99ac1e04-1a89-4eee-810e-ef06dc27706b" released by "delete_volume" :: held 0.710s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:11 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.425s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:11 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 Nov 02 09:42:11 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Created reservations ['e014433f-a148-468e-b727-3df7e982df69', '3196f9b4-4f84-48ec-b983-84f5145e49f2', 'a080e3d3-7347-4a51-b830-ec067438648b', 'be31f911-80b2-4f9b-b656-d779a3fdd2e2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:11 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:11 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:11 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:11 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 Nov 02 09:42:11 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-f68ce30b-2296-4077-8871-033323358e74-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "cinder-f68ce30b-2296-4077-8871-033323358e74-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-f68ce30b-2296-4077-8871-033323358e74" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-f68ce30b-2296-4077-8871-033323358e74" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:11 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.333s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3128c070-e64c-4882-b2a8-aa6b7b8d8e31]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5607350a-8588-4f5f-bc9a-426c7fda38d6 tempest-VolumesGetTest-2144186329 None] Lock "cinder-99ac1e04-1a89-4eee-810e-ef06dc27706b-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:11 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:42:11 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:11 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709" returned: 0 in 0.572s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:12 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709 Nov 02 09:42:12 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:12 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.697s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:12 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.605aafa3-96e2-411b-b569-9314e18df709" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:12 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74 Nov 02 09:42:12 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-605aafa3-96e2-411b-b569-9314e18df709" released by "_delete_snapshot" :: held 2.129s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_snapshot" :: held 2.176s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Created reservations ['336eaecf-6a89-44d7-ac5d-d3764386d46c', 'c5cea301-fc5b-40ca-a334-85402f5e6ced', '1c9a2b4c-8d3a-4eff-b50d-b33bc0fe17a1', '472027f8-d168-4eb5-8c60-67f2c9150c80'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:12 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Delete snapshot completed successfully. Nov 02 09:42:12 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8ac21f2c-a280-46ca-b027-ad6c43972bc8 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-605aafa3-96e2-411b-b569-9314e18df709-delete_snapshot" released by "delete_snapshot" :: held 2.527s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f68ce30b-2296-4077-8871-033323358e74" returned: 0 in 0.438s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-f68ce30b-2296-4077-8871-033323358e74" released by "delete_volume" :: held 1.239s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Created reservations ['c186b4b1-451a-4dca-8d9a-1e59b123c175', '0a8cc0f0-964c-4d96-a73f-1b531e1ddb5e', '648ae513-dc80-4d59-8310-fdd2c726bbc0', 'c72afcd6-4f83-497d-9bb1-c3b8422f2c26'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:13 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:13 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:13 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.504s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:42:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ca65cad-cf3a-429a-bcf0-df08c94caac0 tempest-VolumesGetTest-2144186329 None] Lock "cinder-f68ce30b-2296-4077-8871-033323358e74-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (a0b7b78a-6bf0-411a-9d15-5911236c44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734f5628-1b59-42ea-94fc-043e80f7f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734f5628-1b59-42ea-94fc-043e80f7f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-750622852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352283cf-5aa6-4d66-954c-00a886100b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:16Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58947985-46b2-4a4e-b78f-b18f241f73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58947985-46b2-4a4e-b78f-b18f241f73bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa3a654-0785-4ad3-8454-cbe180894299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:15 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa3a654-0785-4ad3-8454-cbe180894299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '352283cf-5aa6-4d66-954c-00a886100b21', 'volume_name': 'volume-352283cf-5aa6-4d66-954c-00a886100b21', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654a813c-c623-4140-ad9e-9e3a62e88568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654a813c-c623-4140-ad9e-9e3a62e88568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64277612-378e-4aeb-9e7c-fe26bca0dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:16 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Volume 352283cf-5aa6-4d66-954c-00a886100b21: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-352283cf-5aa6-4d66-954c-00a886100b21', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Trying to clone 352283cf-5aa6-4d66-954c-00a886100b21 from image e2facddb-b106-4022-8544-580b8fc5acbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:42:16 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Image download 20.69 MB at 20.69 MB/s Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7732dac-8fe5-4747-94c9-0e46616cce6f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:17 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD Nov 02 09:42:17 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:17 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD" returned: 0 in 0.610s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:17 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd is fetched for user 6b1f6d6ed6264a928140459da4c38a7f. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:42:17 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe45006b-6275-44ad-a893-38b85b5e0630]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:17 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD Nov 02 09:42:17 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:18 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD" returned: 0 in 0.699s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:18 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" returned: 0 in 7.209s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:42:18 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Converted 1024.00 MB image at 142.02 MB/s Nov 02 09:42:18 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 is being set with open permissions: ugo+rw Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:18 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 Nov 02 09:42:18 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:18 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" returned: 0 in 0.248s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" released by "_copy_volume_from_snapshot" :: held 8.598s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" released by "_create_volume_from_snapshot" :: held 8.787s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.849s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.546s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Creating offline snapshot 5c513f75-54fa-4688-b1bf-5b7dfe6cd268 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9253395-5bd1-4085-a718-905c431e92aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1', 'volume_size': 1, 'snapshot_id': '5864ef8e-2f73-457f-a2c3-f70e96781075'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dae71a1-dfed-4572-af94-ca39e94dbb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5208158-0238-4b0d-97a1-827b826903cb]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Volume volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 (979933d9-4e4b-4b8d-9f77-ddfc92bad9f1): created successfully Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dae71a1-dfed-4572-af94-ca39e94dbb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Flow 'volume_create_manager' (1df00eb6-bc15-4e12-ae85-fba109f4ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8860d10a-5e1b-4374-a0c4-1c991720dfbe tempest-VolumesDeleteCascade-318922578 None] Created volume successfully. Nov 02 09:42:19 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:19 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:19 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.348s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:19 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 1G Nov 02 09:42:19 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:19 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 1G" returned: 0 in 0.493s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:19 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 Nov 02 09:42:19 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Performing cascade delete. {{(pid=86887) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-5864ef8e-2f73-457f-a2c3-f70e96781075-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-5864ef8e-2f73-457f-a2c3-f70e96781075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Deleting offline snapshot 5864ef8e-2f73-457f-a2c3-f70e96781075 of volume 7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] snapshot_file for this snap is: volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[777584ea-8f9f-4059-86bf-eae1772f9dcf]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:20 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268" returned: 0 in 0.351s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:20 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 is being set with open permissions: ugo+rw Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:20 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 Nov 02 09:42:20 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:20 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:20 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:20 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268" returned: 0 in 0.256s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-750622852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352283cf-5aa6-4d66-954c-00a886100b21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:16Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Creating volume 352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:20 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:20 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1073741824 Nov 02 09:42:20 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:20 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9a151290-546d-4d9d-8903-2c743178c599 tempest-SnapshotsActionsTest-1329503785 None] Create snapshot completed successfully Nov 02 09:42:20 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.413s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f294947f-1799-44db-92e2-787648364695]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:20 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:20 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-5c513f75-54fa-4688-b1bf-5b7dfe6cd268-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-5c513f75-54fa-4688-b1bf-5b7dfe6cd268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-5c513f75-54fa-4688-b1bf-5b7dfe6cd268" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-5c513f75-54fa-4688-b1bf-5b7dfe6cd268" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Deleting offline snapshot 5c513f75-54fa-4688-b1bf-5b7dfe6cd268 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] snapshot_file for this snap is: volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff78f7c-5712-44fe-98a1-cec2ecac865b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 Nov 02 09:42:21 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1073741824" returned: 0 in 0.681s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (3c6cd307-e24d-43bd-95d9-f9a38e340f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d14a1f4-6ec9-4ac6-befc-eb061b021f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 Nov 02 09:42:21 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d14a1f4-6ec9-4ac6-befc-eb061b021f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1489589734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f644c0-2a64-4678-af6e-b90f60239bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:21Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74abefd-5469-4234-9684-12e83d258af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74abefd-5469-4234-9684-12e83d258af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0e37a-5201-450a-9c69-44b3c2a63b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b0e37a-5201-450a-9c69-44b3c2a63b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f644c0-2a64-4678-af6e-b90f60239bad', 'volume_name': 'volume-a3f644c0-2a64-4678-af6e-b90f60239bad', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:21 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a6583c-8929-4af3-bbcb-a3cfe5254ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a6583c-8929-4af3-bbcb-a3cfe5254ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c48c92-5a37-4cc1-bcb5-eed5744a6c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Volume a3f644c0-2a64-4678-af6e-b90f60239bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f644c0-2a64-4678-af6e-b90f60239bad', 'volume_size': 1} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.741s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:21 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f1ed9-2c42-4585-8c89-60ee8eb691ad]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21" returned: 0 in 0.297s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.233s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1489589734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f644c0-2a64-4678-af6e-b90f60239bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:21Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Creating volume a3f644c0-2a64-4678-af6e-b90f60239bad {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:21 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:21 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad 1073741824 Nov 02 09:42:21 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Attempting download of e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 352283cf-5aa6-4d66-954c-00a886100b21. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d60fb8f-9cb9-4a6f-b327-a04f6168dccc]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.423s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075 Nov 02 09:42:21 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c Nov 02 09:42:21 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.413s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:21 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 Nov 02 09:42:21 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:21 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad 1073741824" returned: 0 in 0.549s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75.5864ef8e-2f73-457f-a2c3-f70e96781075" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c Nov 02 09:42:22 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-5864ef8e-2f73-457f-a2c3-f70e96781075" released by "_delete_snapshot" :: held 2.103s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" released by "delete_snapshot" :: held 2.141s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad Nov 02 09:42:22 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Created reservations ['0e386f5b-0bff-4f4d-b6ef-46507697a8a3', 'f0448241-1436-42b9-955b-ccba68476790', '26c5efc4-bbba-4801-995c-6363fe66d5e2', '240c6001-59cc-4ec2-b885-c0574ff5694b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Delete snapshot completed successfully. Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-5864ef8e-2f73-457f-a2c3-f70e96781075-delete_snapshot" released by "delete_snapshot" :: held 2.361s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Snapshots deleted, issuing volume delete {{(pid=86887) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:22 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268" returned: 0 in 0.547s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc1b411-684f-41e8-b9b3-997a1adf981f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268 Nov 02 09:42:22 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c" returned: 1 in 0.444s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_mmn1rp9c' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[60be8a30-3340-40af-831a-447559719a38]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad" returned: 0 in 0.354s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9c48c92-5a37-4cc1-bcb5-eed5744a6c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f644c0-2a64-4678-af6e-b90f60239bad', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ce4b1-f347-4458-a844-05b65e2a625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Volume volume-a3f644c0-2a64-4678-af6e-b90f60239bad (a3f644c0-2a64-4678-af6e-b90f60239bad): created successfully Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ce4b1-f347-4458-a844-05b65e2a625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:22 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:22 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (3c6cd307-e24d-43bd-95d9-f9a38e340f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:22 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD Nov 02 09:42:22 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8e79e84d-97dd-4060-9f93-d5c3624034bf tempest-AttachVolumeTestJSON-971588719 None] Created volume successfully. Nov 02 09:42:22 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.5c513f75-54fa-4688-b1bf-5b7dfe6cd268" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-5c513f75-54fa-4688-b1bf-5b7dfe6cd268" released by "_delete_snapshot" :: held 1.947s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_snapshot" :: held 1.988s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:22 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] e2facddb-b106-4022-8544-580b8fc5acbd was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 Nov 02 09:42:22 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.453s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Created reservations ['5245c342-fd0a-450a-8124-a0a64c798b0d', '3321b586-7aad-4493-937a-e7617b83c308', '8041b6af-f032-4e32-b307-859856ba2cdb', '41d2368b-2956-4f28-8630-27922b9a2699'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:22 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75 Nov 02 09:42:22 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Delete snapshot completed successfully. Nov 02 09:42:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a147d11f-048d-415b-a647-886d3584c6a6 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-5c513f75-54fa-4688-b1bf-5b7dfe6cd268-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:23 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" returned: 0 in 0.269s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75" released by "delete_volume" :: held 0.818s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Created reservations ['ff7782cf-6f34-4bf5-9668-f50e4129fc59', '4247a600-86fd-4fe9-9086-84e0406fd39e', '62c37292-80a5-42f4-8abb-002f71d41b7a', 'a10791fa-d248-48cf-b538-731108736ddb'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:23 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:23 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:23 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Deleted volume successfully. Nov 02 09:42:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-589dad6b-18d0-46b0-b742-cadeb976e88b tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-7b98b5c6-f8f9-4cf5-9dab-cbbe9b690f75-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-1229edff-554c-4997-9813-539bb42121d3 req-8e2e4faf-4560-40d1-829a-006a387928ac tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-1229edff-554c-4997-9813-539bb42121d3 req-8e2e4faf-4560-40d1-829a-006a387928ac tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-1229edff-554c-4997-9813-539bb42121d3 req-8e2e4faf-4560-40d1-829a-006a387928ac tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-1229edff-554c-4997-9813-539bb42121d3 req-8e2e4faf-4560-40d1-829a-006a387928ac tempest-AttachVolumeTestJSON-971588719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-a3f644c0-2a64-4678-af6e-b90f60239bad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42a3d2f1-8f09-4f0a-97ea-c80d00ededc3', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Creating offline snapshot f9729a8d-0ad4-4c36-b03b-17cc2011f302 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f064c01-09d5-4ade-8031-bca3e505d3b4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-1229edff-554c-4997-9813-539bb42121d3 req-8e2e4faf-4560-40d1-829a-006a387928ac tempest-AttachVolumeTestJSON-971588719 None] attachment_update completed successfully. Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:24 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:24 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ac4e1-9a46-4802-9e2c-c4c854bf0165]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:24 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 Nov 02 09:42:24 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:25 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.573s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:25 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 1G Nov 02 09:42:25 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:25 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" returned: 0 in 0.508s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:25 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21" returned: 0 in 2.495s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_7q2iz54qdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:42:25 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Converted 112.00 MB image at 44.86 MB/s Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:25 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1 Nov 02 09:42:25 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:25 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1G Nov 02 09:42:25 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:25 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-quobyte-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1" released by "delete_volume" :: held 0.929s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Created reservations ['e44ab94d-1a43-4e61-aa14-c2fe109084f9', '12fc7518-db7f-4e9e-9d1c-d9310b0a8458', 'f6c514cb-e16b-41ca-ad3d-12e33ec2876b', 'b278971e-cd94-4516-bb45-223373b66a2b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:25 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 1G" returned: 0 in 0.676s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:25 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:25 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 Nov 02 09:42:25 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 1G" returned: 0 in 0.524s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Downloaded image e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 352283cf-5aa6-4d66-954c-00a886100b21 successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd for user 6b1f6d6ed6264a928140459da4c38a7f is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Marking volume 352283cf-5aa6-4d66-954c-00a886100b21 as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Copying metadata from image e2facddb-b106-4022-8544-580b8fc5acbd to 352283cf-5aa6-4d66-954c-00a886100b21. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Creating volume glance metadata for volume 352283cf-5aa6-4d66-954c-00a886100b21 backed by image e2facddb-b106-4022-8544-580b8fc5acbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:25 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:25 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64277612-378e-4aeb-9e7c-fe26bca0dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352283cf-5aa6-4d66-954c-00a886100b21', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae47870-f738-454e-aa37-e2b329006d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:26 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Volume volume-352283cf-5aa6-4d66-954c-00a886100b21 (352283cf-5aa6-4d66-954c-00a886100b21): created successfully Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae47870-f738-454e-aa37-e2b329006d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (a0b7b78a-6bf0-411a-9d15-5911236c44e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-426c10e4-0838-47f5-9d77-eaa52ffbc5e0 tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:42:26 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302" returned: 0 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:26 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 is being set with open permissions: ugo+rw Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:26 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.329s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Deleted volume successfully. Nov 02 09:42:26 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 Nov 02 09:42:26 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5d994db3-641d-43d5-9e62-575e2150865d tempest-VolumesDeleteCascade-318922578 None] Lock "cinder-979933d9-4e4b-4b8d-9f77-ddfc92bad9f1-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:26 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3b67f4db-dbb7-4f51-8a7b-23dc7c55c115 tempest-SnapshotsActionsTest-1329503785 None] Create snapshot completed successfully Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (af8e1885-c37c-481e-ba41-da4448c3b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22947f91-c927-487b-9285-c964756c8121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22947f91-c927-487b-9285-c964756c8121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107707847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:27Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d441b-8b51-4389-8363-b244108c1c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99d441b-8b51-4389-8363-b244108c1c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6fa111-27cd-4b07-b05d-5f1d8716eecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6fa111-27cd-4b07-b05d-5f1d8716eecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916', 'volume_name': 'volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172d53b-b360-4bc9-b385-49d51682a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172d53b-b360-4bc9-b385-49d51682a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287c7a8-20be-4a53-bae3-0f4ec597f098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Volume 9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916', 'volume_size': 1} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2107707847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91e18274689d4500aae0c9146dad6d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:27Z,use_quota=True,user_id='e7f4e51533f841e4ba5a8db089e673e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Creating volume 9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:27 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:27 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 1073741824 Nov 02 09:42:27 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (da88a908-de73-4672-9151-ececca748a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4451563c-6bb1-4fbf-aacf-7a90cc9d1bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4451563c-6bb1-4fbf-aacf-7a90cc9d1bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1024812956',display_name='tempest-VolumesGetTest-Volume-1812063289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1f3336-4d87-4e6b-a76c-7c5df51c3855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:28Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad29b8-3d16-423a-9d42-896416e52b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad29b8-3d16-423a-9d42-896416e52b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d97811-c76c-4fb0-8233-c58a8a28e6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d97811-c76c-4fb0-8233-c58a8a28e6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1f3336-4d87-4e6b-a76c-7c5df51c3855', 'volume_name': 'volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02a917a-8411-4f51-ba3d-3dbaa135c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02a917a-8411-4f51-ba3d-3dbaa135c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c351187-c545-48a4-bda0-a1eba67a4c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:27 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Volume 6f1f3336-4d87-4e6b-a76c-7c5df51c3855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855', 'volume_size': 1} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-f9729a8d-0ad4-4c36-b03b-17cc2011f302-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-f9729a8d-0ad4-4c36-b03b-17cc2011f302-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-f9729a8d-0ad4-4c36-b03b-17cc2011f302" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-f9729a8d-0ad4-4c36-b03b-17cc2011f302" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Deleting offline snapshot f9729a8d-0ad4-4c36-b03b-17cc2011f302 of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] snapshot_file for this snap is: volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:27 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 1073741824" returned: 0 in 0.680s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026b74e-a0a6-4ad4-a117-aaf461f593a7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:27 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 Nov 02 09:42:27 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:28 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 Nov 02 09:42:28 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:28 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1024812956',display_name='tempest-VolumesGetTest-Volume-1812063289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1f3336-4d87-4e6b-a76c-7c5df51c3855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32216ecf9ef048d0bf5a28e4d0f8cf13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:28Z,use_quota=True,user_id='6b1f6d6ed6264a928140459da4c38a7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Creating volume 6f1f3336-4d87-4e6b-a76c-7c5df51c3855 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:28 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287c7a8-20be-4a53-bae3-0f4ec597f098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd6fef5-0c6a-480f-be25-b778639948ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:28 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 1073741824 Nov 02 09:42:28 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:28 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Volume volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 (9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916): created successfully Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd6fef5-0c6a-480f-be25-b778639948ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Flow 'volume_create_manager' (af8e1885-c37c-481e-ba41-da4448c3b949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-63f50034-e0ae-4382-aadf-43c90dab0343 tempest-AttachVolumeTestJSON-971588719 None] Created volume successfully. Nov 02 09:42:28 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302" returned: 0 in 0.522s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf1dc81-ad15-4dff-ac80-b2c50b21802c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:28 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:28 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:28 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 1073741824" returned: 0 in 0.566s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:28 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 Nov 02 09:42:28 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:28 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:28 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 Nov 02 09:42:28 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:29 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" returned: 0 in 0.298s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c351187-c545-48a4-bda0-a1eba67a4c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f334624-3df6-46af-887b-6b33f40a43ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:29 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Volume volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 (6f1f3336-4d87-4e6b-a76c-7c5df51c3855): created successfully Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f334624-3df6-46af-887b-6b33f40a43ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Flow 'volume_create_manager' (da88a908-de73-4672-9151-ececca748a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:29 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a035516c-59a2-4a43-a678-50924b7364bd tempest-VolumesGetTest-2144186329 None] Created volume successfully. Nov 02 09:42:29 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302" returned: 0 in 0.464s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:29 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302 Nov 02 09:42:29 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:29 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.f9729a8d-0ad4-4c36-b03b-17cc2011f302" returned: 0 in 0.295s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-f9729a8d-0ad4-4c36-b03b-17cc2011f302" released by "_delete_snapshot" :: held 1.922s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_snapshot" :: held 1.947s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-6f1f3336-4d87-4e6b-a76c-7c5df51c3855-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Created reservations ['b054c5c0-23df-4f5e-bb77-d617faaf9075', 'e5537f0a-0bae-4e33-9e9f-01397943ae31', '8081ada8-1445-494f-94e9-09b93dc075c2', '217fae42-4d41-4b78-8e72-a7e1338c303a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "cinder-6f1f3336-4d87-4e6b-a76c-7c5df51c3855-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Delete snapshot completed successfully. Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f24af93b-0bbc-4a08-a03f-2a921862fb3a tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-f9729a8d-0ad4-4c36-b03b-17cc2011f302-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfbee43-c644-41ce-b5c0-805d76047cba]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:30 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 Nov 02 09:42:30 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5786f222-b0ff-4d6d-8f41-8b525b6d4060 req-78bf45cf-3902-4fdf-aee7-3e98c2e1d18f tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5786f222-b0ff-4d6d-8f41-8b525b6d4060 req-78bf45cf-3902-4fdf-aee7-3e98c2e1d18f tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5786f222-b0ff-4d6d-8f41-8b525b6d4060 req-78bf45cf-3902-4fdf-aee7-3e98c2e1d18f tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-5786f222-b0ff-4d6d-8f41-8b525b6d4060 req-78bf45cf-3902-4fdf-aee7-3e98c2e1d18f tempest-AttachVolumeTestJSON-971588719 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08d1a7a3-ee2a-4f56-b0f1-f5709ebbecda', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:42:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-5786f222-b0ff-4d6d-8f41-8b525b6d4060 req-78bf45cf-3902-4fdf-aee7-3e98c2e1d18f tempest-AttachVolumeTestJSON-971588719 None] attachment_update completed successfully. Nov 02 09:42:30 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:30 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855 Nov 02 09:42:30 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:30 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-6f1f3336-4d87-4e6b-a76c-7c5df51c3855" released by "delete_volume" :: held 0.853s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Created reservations ['81761f8a-1f85-42e7-9d92-9198556da4ec', '853058e3-995e-49fa-9170-408eb1ac7904', 'ef935ac9-eb71-444e-9295-c689074736f7', '0ac6b439-0d1b-498f-a1db-34b63f199c68'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:31 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:31 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-352283cf-5aa6-4d66-954c-00a886100b21-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "cinder-352283cf-5aa6-4d66-954c-00a886100b21-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Acquiring lock "cinder-quobyte-352283cf-5aa6-4d66-954c-00a886100b21" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-352283cf-5aa6-4d66-954c-00a886100b21" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:31 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd93821-13a7-46a8-80dc-0eb236c8430d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.495s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f0a69cb-4825-4197-92cd-0dae5f364967 tempest-VolumesGetTest-2144186329 None] Lock "cinder-6f1f3336-4d87-4e6b-a76c-7c5df51c3855-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:31 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 Nov 02 09:42:31 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Creating offline snapshot ee95ca92-714d-4299-949f-19f74c9b609d of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc44384-e481-4354-bcc2-d806d10d7dc5]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:32 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:32 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:32 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21" returned: 0 in 0.554s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:32 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21 Nov 02 09:42:32 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:32 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.497s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:32 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d 1G Nov 02 09:42:32 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:32 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-352283cf-5aa6-4d66-954c-00a886100b21" returned: 0 in 0.321s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "cinder-quobyte-352283cf-5aa6-4d66-954c-00a886100b21" released by "delete_volume" :: held 0.973s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-28206e80-1456-4e3b-a1b3-00633fabeee0 req-b913c6cf-fc1f-4d9d-ab6e-9719f25e7a9f tempest-AttachVolumeTestJSON-971588719 None] Terminate volume connection completed successfully. Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-28206e80-1456-4e3b-a1b3-00633fabeee0 req-b913c6cf-fc1f-4d9d-ab6e-9719f25e7a9f tempest-AttachVolumeTestJSON-971588719 None] Deleting attachment 42a3d2f1-8f09-4f0a-97ea-c80d00ededc3. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Created reservations ['1a16deb2-61a0-42f2-a919-9c1c46887fbc', '35765c13-0a4d-4773-b855-b43b7b74d87d', '5ca2789e-0fdd-4a19-810d-6e97c44d3f16', '15a4c9b1-8678-4ab1-be71-b7b52c4d1ed2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:32 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:32 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:33 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d 1G" returned: 0 in 0.659s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:33 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d Nov 02 09:42:33 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:33 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.316s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Deleted volume successfully. Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-348039fc-d88c-4f0c-bc7a-a39bb27cfd28 tempest-VolumesGetTest-2144186329 None] Lock "cinder-352283cf-5aa6-4d66-954c-00a886100b21-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:33 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:33 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d is being set with open permissions: ugo+rw Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:33 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d Nov 02 09:42:33 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:33 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d" returned: 0 in 0.384s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.077s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a325c4d3-61a4-4fbe-8998-bab347e9c00f tempest-SnapshotsActionsTest-1329503785 None] Create snapshot completed successfully Nov 02 09:42:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-c5b48dde-8354-4a2d-8b4d-743becf3e1b1 req-b380616c-65a8-4607-9812-878b53f2e76b tempest-AttachVolumeTestJSON-971588719 None] Terminate volume connection completed successfully. Nov 02 09:42:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-c5b48dde-8354-4a2d-8b4d-743becf3e1b1 req-b380616c-65a8-4607-9812-878b53f2e76b tempest-AttachVolumeTestJSON-971588719 None] Deleting attachment 08d1a7a3-ee2a-4f56-b0f1-f5709ebbecda. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-ee95ca92-714d-4299-949f-19f74c9b609d-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-ee95ca92-714d-4299-949f-19f74c9b609d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Acquiring lock "cinder-quobyte-ee95ca92-714d-4299-949f-19f74c9b609d" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-ee95ca92-714d-4299-949f-19f74c9b609d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Deleting offline snapshot ee95ca92-714d-4299-949f-19f74c9b609d of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] snapshot_file for this snap is: volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce745f00-78c9-444c-9ed6-120b7ce23f5d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:35 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d Nov 02 09:42:35 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:35 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d" returned: 0 in 0.498s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2bcf1-e9f9-4cf9-ac75-02554096f47e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:36 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:36 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:36 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.656s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:36 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d Nov 02 09:42:36 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:37 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d" returned: 0 in 0.593s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:37 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d Nov 02 09:42:37 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:37 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.ee95ca92-714d-4299-949f-19f74c9b609d" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-ee95ca92-714d-4299-949f-19f74c9b609d" released by "_delete_snapshot" :: held 2.225s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_snapshot" :: held 2.264s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Created reservations ['0651d821-117e-42e3-b54b-06c1c10092a9', '66c98521-a17b-4e93-b6c8-aaf433fd3131', 'fbd01cf4-2424-4e96-b966-3609196be66b', 'f524a190-387a-4620-8209-e5377fe06861'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Delete snapshot completed successfully. Nov 02 09:42:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3fecd60d-8a22-4956-a2b8-9e92ec4d8229 tempest-SnapshotsActionsTest-2002477896 None] Lock "cinder-ee95ca92-714d-4299-949f-19f74c9b609d-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "cinder-fbd8e5e6-e86a-4fd3-a154-cb105de20afb-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-fbd8e5e6-e86a-4fd3-a154-cb105de20afb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "cinder-quobyte-fbd8e5e6-e86a-4fd3-a154-cb105de20afb" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-fbd8e5e6-e86a-4fd3-a154-cb105de20afb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Deleting offline snapshot fbd8e5e6-e86a-4fd3-a154-cb105de20afb of volume 3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] snapshot_file for this snap is: volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fef110-a96e-4a77-8bf2-b15e53abb45b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:39 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:39 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:40 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.464s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ed6905-07be-4958-8afc-f820960a8d83]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:40 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 Nov 02 09:42:40 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:40 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249" returned: 0 in 0.556s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:40 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:40 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:41 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.419s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:41 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb Nov 02 09:42:41 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:41 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249.fbd8e5e6-e86a-4fd3-a154-cb105de20afb" returned: 0 in 0.269s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-fbd8e5e6-e86a-4fd3-a154-cb105de20afb" released by "_delete_snapshot" :: held 1.873s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_snapshot" :: held 1.926s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Created reservations ['01b300c1-7ea1-49a4-9ba4-09875e9a971e', 'e5040cdd-075e-4fdd-9215-c1cf23c9e8fd', '393747c4-f3b2-4dc3-aaf2-ed2a859d62d2', 'f4079f1e-9447-4bce-aea7-e877df956e9a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Delete snapshot completed successfully. Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0bce74b1-60b6-4a93-86a4-a1cc70751a5e tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-fbd8e5e6-e86a-4fd3-a154-cb105de20afb-delete_snapshot" released by "delete_snapshot" :: held 2.086s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "cinder-3d055cd4-8e65-492f-b1fb-4738bfbe7249-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-3d055cd4-8e65-492f-b1fb-4738bfbe7249-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" acquired by "delete_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc13c6-c0e7-4b9f-b105-d6b02e35d6f2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:42 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 Nov 02 09:42:42 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:42 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:42 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249 Nov 02 09:42:42 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:42 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3d055cd4-8e65-492f-b1fb-4738bfbe7249" returned: 0 in 0.250s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-quobyte-3d055cd4-8e65-492f-b1fb-4738bfbe7249" released by "delete_volume" :: held 0.774s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Created reservations ['742fd0f5-156a-40a2-8a7a-ffb51e34fd2b', '54497d5a-c0d8-4e54-9b11-b629e371ddd1', 'bb2e2908-cd42-4a61-9619-2ee505def70f', '9b6d1206-78b9-43fe-8325-183b87589ca9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:42 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:42 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:43 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.284s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:43 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Deleted volume successfully. Nov 02 09:42:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3ad153b4-7705-4ab7-8b0a-1945497fe4ad tempest-SnapshotsActionsTest-1329503785 None] Lock "cinder-3d055cd4-8e65-492f-b1fb-4738bfbe7249-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-quobyte-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a8f34-1693-42d9-ba78-2d6d31c23e15]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:44 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 Nov 02 09:42:44 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:45 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:45 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916 Nov 02 09:42:45 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:45 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916" released by "delete_volume" :: held 0.880s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Created reservations ['f03aa2ca-8d23-4a81-8e5d-a35ca5ac8cb0', '05a34c62-b6c9-4371-9047-ec5e860a85de', '030be046-df53-4620-8fab-dd93dcbe7bf8', 'a786ca4a-9084-4d72-88f6-a54c801df6f0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:45 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:45 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-a3f644c0-2a64-4678-af6e-b90f60239bad-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-a3f644c0-2a64-4678-af6e-b90f60239bad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-quobyte-a3f644c0-2a64-4678-af6e-b90f60239bad" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-a3f644c0-2a64-4678-af6e-b90f60239bad" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[213bc45d-10d7-437b-97d0-3b5ec39888fa]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:46 devstack sudo[96382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad Nov 02 09:42:46 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:46 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Flow 'volume_create_manager' (96314ab8-51d5-4a71-8bdb-9d709b9406d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64cd8c-8c98-4aa4-8b42-7bd60cf70d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.520s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Deleted volume successfully. Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b64cd8c-8c98-4aa4-8b42-7bd60cf70d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-148826294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512e1d4b-5061-48a3-be29-705f38e3fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a751ee0d112d401ea31f6bd15de78586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:46Z,use_quota=True,user_id='59b7ea817f6548a6bcb5d6de7c44325c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245ca0cb-7bed-4ea3-9043-26523e9b154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245ca0cb-7bed-4ea3-9043-26523e9b154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9797561e-4a01-4179-902c-44dbb5e92d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9797561e-4a01-4179-902c-44dbb5e92d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512e1d4b-5061-48a3-be29-705f38e3fd9c', 'volume_name': 'volume-512e1d4b-5061-48a3-be29-705f38e3fd9c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd92d2b-9ca7-4667-bcc8-381f09152104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd92d2b-9ca7-4667-bcc8-381f09152104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c60714-8547-4dda-90b0-04b663e9b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Volume 512e1d4b-5061-48a3-be29-705f38e3fd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512e1d4b-5061-48a3-be29-705f38e3fd9c', 'volume_size': 1} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-148826294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512e1d4b-5061-48a3-be29-705f38e3fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a751ee0d112d401ea31f6bd15de78586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:46Z,use_quota=True,user_id='59b7ea817f6548a6bcb5d6de7c44325c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Creating volume 512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:46 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-155a3d35-7454-49f3-8444-a19772153afd tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-9ed6ff9e-f791-4c4a-95a3-7ddccc3e2916-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:46 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c 1073741824 Nov 02 09:42:46 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:46 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad" returned: 0 in 0.498s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:46 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad Nov 02 09:42:46 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:46 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a3f644c0-2a64-4678-af6e-b90f60239bad" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-a3f644c0-2a64-4678-af6e-b90f60239bad" released by "delete_volume" :: held 0.869s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Created reservations ['f7f26a3f-88cf-4347-96b1-cc50b47d7b7d', '589b2d18-3f9d-4f95-9baf-e772f1aaab1c', 'd8d64a00-5d40-4715-84a1-966d02f41cc7', 'd10bcd18-ea2e-4bb4-a699-f7ad96307a74'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:46 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c 1073741824" returned: 0 in 0.593s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:47 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:47 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:47 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:42:47 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-74de7428-3aa2-4751-ba5c-36e33292ce6a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-74de7428-3aa2-4751-ba5c-36e33292ce6a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "cinder-quobyte-74de7428-3aa2-4751-ba5c-36e33292ce6a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-74de7428-3aa2-4751-ba5c-36e33292ce6a" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[61128674-7bd8-4360-8e0c-d9f28362a22c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:47 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:47 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.457s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Deleted volume successfully. Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c60714-8547-4dda-90b0-04b663e9b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512e1d4b-5061-48a3-be29-705f38e3fd9c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a6991-4885-415d-b7eb-e852392ae92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f43aa3d0-f650-4ca4-870e-513d5c9c5a4b tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-a3f644c0-2a64-4678-af6e-b90f60239bad-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Volume volume-512e1d4b-5061-48a3-be29-705f38e3fd9c (512e1d4b-5061-48a3-be29-705f38e3fd9c): created successfully Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0a6991-4885-415d-b7eb-e852392ae92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Flow 'volume_create_manager' (96314ab8-51d5-4a71-8bdb-9d709b9406d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bf9fb259-e8af-4c37-a6be-c13feb90b837 tempest-VolumesActionsTest-1390322316 None] Created volume successfully. Nov 02 09:42:47 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a Nov 02 09:42:47 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:48 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a" returned: 0 in 0.682s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:48 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a Nov 02 09:42:48 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:48 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-74de7428-3aa2-4751-ba5c-36e33292ce6a" returned: 0 in 0.322s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-quobyte-74de7428-3aa2-4751-ba5c-36e33292ce6a" released by "delete_volume" :: held 1.093s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Created reservations ['1beb213a-d78b-4a8b-b074-309836718c10', 'bf9eb476-a5c0-4b21-9e4a-f6a9a9ab39e2', 'db7774fa-1574-4b17-9c71-fe1b7ce8d6bf', 'e516428c-8c14-43e5-bd50-9f9a3f78536d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:48 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:48 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:49 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.379s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:49 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Deleted volume successfully. Nov 02 09:42:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b59cef75-82ae-4da8-8cbd-7e811a771a07 tempest-AttachVolumeTestJSON-971588719 None] Lock "cinder-74de7428-3aa2-4751-ba5c-36e33292ce6a-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:58 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:42:58 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=158,cinder:INSERT=41,cinder:SELECT=138,cinder:DELETE=11 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:42:58 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.501s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (08d38099-209f-4bf0-908d-b44fdca34695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5b3f5a-05dc-4508-9615-f8ef8a1431f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5b3f5a-05dc-4508-9615-f8ef8a1431f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-616348725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539bfee6-ba43-4ac4-b5ea-196c5d52ca8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:59Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cdb9a-7e89-4fdf-b9a6-ec62c5c60a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cdb9a-7e89-4fdf-b9a6-ec62c5c60a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af626153-d5f8-4e18-a20c-b89681d66372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af626153-d5f8-4e18-a20c-b89681d66372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539bfee6-ba43-4ac4-b5ea-196c5d52ca8d', 'volume_name': 'volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970e0025-0d24-4fb9-88a4-91de05a2dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970e0025-0d24-4fb9-88a4-91de05a2dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd1d3a-a88d-466b-82ec-0a54a57bc82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:42:58 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Volume 539bfee6-ba43-4ac4-b5ea-196c5d52ca8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d', 'volume_size': 1} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-616348725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539bfee6-ba43-4ac4-b5ea-196c5d52ca8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:42:59Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Creating volume 539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:42:58 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:42:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:59 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d 1073741824 Nov 02 09:42:59 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:42:59 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Nov 02 09:42:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d 1073741824" returned: 0 in 0.697s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:42:59 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=162,cinder:SELECT=146,cinder:DELETE=15,cinder:INSERT=51 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:42:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:42:59 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d Nov 02 09:42:59 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:00 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ccd1d3a-a88d-466b-82ec-0a54a57bc82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52e654d-48ec-452b-9f85-3cc4da033e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:00 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Volume volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d (539bfee6-ba43-4ac4-b5ea-196c5d52ca8d): created successfully Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52e654d-48ec-452b-9f85-3cc4da033e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (08d38099-209f-4bf0-908d-b44fdca34695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-44ac3010-dd2b-4586-ae99-3d169a6c42f2 tempest-VolumesSnapshotTestJSON-916430247 None] Created volume successfully. Nov 02 09:43:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Creating offline snapshot cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 of volume 539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:43:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0610564c-52cb-4025-9c63-35cce817c371]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:02 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d Nov 02 09:43:02 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:02 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" returned: 0 in 0.899s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:02 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 1G Nov 02 09:43:02 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:03 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 1G" returned: 0 in 0.731s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:03 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 Nov 02 09:43:03 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8dc3e571-5f5d-4dc9-9c64-6e6d59366bfd tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" by "attach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8dc3e571-5f5d-4dc9-9c64-6e6d59366bfd tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" acquired by "attach_volume" :: waited 0.042s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:04 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" returned: 0 in 0.688s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:04 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 is being set with open permissions: ugo+rw Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8dc3e571-5f5d-4dc9-9c64-6e6d59366bfd tempest-VolumesActionsTest-1390322316 None] Attaching volume 512e1d4b-5061-48a3-be29-705f38e3fd9c to instance 196cd73a-f165-44a9-8791-255016c2f8ef at mountpoint /dev/vdb on host None. Nov 02 09:43:04 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 Nov 02 09:43:04 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8dc3e571-5f5d-4dc9-9c64-6e6d59366bfd tempest-VolumesActionsTest-1390322316 None] Attach volume completed successfully. Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8dc3e571-5f5d-4dc9-9c64-6e6d59366bfd tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" released by "attach_volume" :: held 0.278s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b35e9c88-aeea-4df3-b6e9-eb2a50f2d537 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" by "detach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:04 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" returned: 0 in 0.423s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b35e9c88-aeea-4df3-b6e9-eb2a50f2d537 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b35e9c88-aeea-4df3-b6e9-eb2a50f2d537 tempest-VolumesActionsTest-1390322316 None] Detaching volume 512e1d4b-5061-48a3-be29-705f38e3fd9c from instance 196cd73a-f165-44a9-8791-255016c2f8ef. Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:04 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info Nov 02 09:43:04 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b35e9c88-aeea-4df3-b6e9-eb2a50f2d537 tempest-VolumesActionsTest-1390322316 None] Detach volume completed successfully. Nov 02 09:43:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b35e9c88-aeea-4df3-b6e9-eb2a50f2d537 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info" returned: 0 in 0.498s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:05 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info is being set with open permissions: ugo+rw Nov 02 09:43:05 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:05 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info Nov 02 09:43:05 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:05 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.info" returned: 0 in 0.408s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.876s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-52cf1f8f-24a0-411e-8dd5-1a686595dafe tempest-VolumesSnapshotTestJSON-916430247 None] Create snapshot completed successfully Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Deleting offline snapshot cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 of volume 539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] snapshot_file for this snap is: volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aed747-0d16-405f-a200-2e0012853625]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:06 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 Nov 02 09:43:06 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:07 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" returned: 0 in 0.592s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a06d08-5533-4896-b7ca-f44fd7586f6e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:07 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d Nov 02 09:43:07 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:07 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" returned: 0 in 0.561s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:07 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 Nov 02 09:43:07 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:08 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" returned: 0 in 0.411s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:08 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5 Nov 02 09:43:08 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:08 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d.cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5" released by "_delete_snapshot" :: held 2.139s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" released by "delete_snapshot" :: held 2.171s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['3b9f045c-1970-42e2-b4de-a70bf135e107', '0b3d9286-5b28-4524-b97a-00300ca38267', '04317d98-6226-466a-85eb-9be59c32c7d8', '77bf1f19-b36d-4e16-a9fc-929e36d6a73c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:43:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Delete snapshot completed successfully. Nov 02 09:43:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-60ce2465-d5a6-4cfe-8a53-4a74b6506ca6 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-cb117fb2-46fc-4f4d-bc7b-abfa6db530f5-delete_snapshot" released by "delete_snapshot" :: held 2.489s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (d7e82f19-c0cd-4ef8-8076-1ca43eef902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9566c233-9e10-4cac-b10f-070f91fed909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9566c233-9e10-4cac-b10f-070f91fed909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-931897395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a08953-d037-4cf9-80f1-25c622b727f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:11Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1050beb5-ec02-4b13-92e3-02d3306e429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1050beb5-ec02-4b13-92e3-02d3306e429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477337ec-150e-416a-b47d-7939a08ecd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477337ec-150e-416a-b47d-7939a08ecd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a08953-d037-4cf9-80f1-25c622b727f9', 'volume_name': 'volume-92a08953-d037-4cf9-80f1-25c622b727f9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0079a78b-2925-42a3-b834-35c88f581096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0079a78b-2925-42a3-b834-35c88f581096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c444b7-686b-4d34-8faf-5a7eed77cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:10 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Volume 92a08953-d037-4cf9-80f1-25c622b727f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a08953-d037-4cf9-80f1-25c622b727f9', 'volume_size': 1} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-931897395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a08953-d037-4cf9-80f1-25c622b727f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:11Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Creating volume 92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:43:10 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:43:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:10 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 1073741824 Nov 02 09:43:10 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:11 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 1073741824" returned: 0 in 0.684s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:11 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:11 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:11 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.427s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c444b7-686b-4d34-8faf-5a7eed77cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a08953-d037-4cf9-80f1-25c622b727f9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb301a-2e08-439e-a670-a89f994a565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Volume volume-92a08953-d037-4cf9-80f1-25c622b727f9 (92a08953-d037-4cf9-80f1-25c622b727f9): created successfully Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb301a-2e08-439e-a670-a89f994a565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (d7e82f19-c0cd-4ef8-8076-1ca43eef902f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:12 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fc5d3e4d-049b-43f1-a1b2-3414730ca4dd tempest-VolumesSnapshotTestJSON-916430247 None] Created volume successfully. Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Creating offline snapshot c6cf2f84-cc66-4313-868b-3ba22a18585e of volume 92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[69824a5e-5222-409d-b0e9-885b7a34f17e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:13 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:13 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:13 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.648s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:13 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e 1G Nov 02 09:43:13 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:14 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e 1G" returned: 0 in 0.620s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a08953-d037-4cf9-80f1-25c622b727f9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:14 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a08953-d037-4cf9-80f1-25c622b727f9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:14 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:14 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92a08953-d037-4cf9-80f1-25c622b727f9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 0.405s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:14 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e is being set with open permissions: ugo+rw Nov 02 09:43:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:14 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:14 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:15 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 0.298s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Flow 'volume_create_manager' (65303f66-21c7-4073-bda7-67e1f96be909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b826d7-7778-420b-b688-6cff7c3a6e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b826d7-7778-420b-b688-6cff7c3a6e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-494313560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1253e19f-e93a-43b4-a6e1-8d451ef93c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de09490302944044b12f8314e49aaa48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:15Z,use_quota=True,user_id='389f3235a04843e8b950d0175fa89958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3a4e3e-4e8d-446f-93e1-af4c7cb7b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:15 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3a4e3e-4e8d-446f-93e1-af4c7cb7b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:15 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6f7bf-76f9-4665-bd53-c6fb535ad54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc6f7bf-76f9-4665-bd53-c6fb535ad54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1253e19f-e93a-43b4-a6e1-8d451ef93c11', 'volume_name': 'volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0572126b-c259-4cbc-892c-642290cec40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0572126b-c259-4cbc-892c-642290cec40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947c673c-c263-4e7a-a855-f6ab5a8f0351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:15 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Volume 1253e19f-e93a-43b4-a6e1-8d451ef93c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11', 'volume_size': 1} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:15 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:15 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info is being set with open permissions: ugo+rw Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:15 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info Nov 02 09:43:15 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:15 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.info" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-494313560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1253e19f-e93a-43b4-a6e1-8d451ef93c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de09490302944044b12f8314e49aaa48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:15Z,use_quota=True,user_id='389f3235a04843e8b950d0175fa89958',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Creating volume 1253e19f-e93a-43b4-a6e1-8d451ef93c11 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:43:15 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:43:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:15 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 1073741824 Nov 02 09:43:15 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-aef34447-f2c3-4b46-8045-f1c136aabf64 tempest-VolumesSnapshotTestJSON-916430247 None] Create snapshot completed successfully Nov 02 09:43:16 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 1073741824" returned: 0 in 0.672s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:16 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 Nov 02 09:43:16 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:17 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (60cdb7ee-a17c-4aad-b9fe-b0bd75daf368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a6eb5d-a9c0-48a1-91d2-f2b7213adc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947c673c-c263-4e7a-a855-f6ab5a8f0351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d3fda7-ed3f-499c-a01b-5fcb511abd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Volume volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 (1253e19f-e93a-43b4-a6e1-8d451ef93c11): created successfully Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d3fda7-ed3f-499c-a01b-5fcb511abd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Flow 'volume_create_manager' (65303f66-21c7-4073-bda7-67e1f96be909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a6eb5d-a9c0-48a1-91d2-f2b7213adc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-337398645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d92220-dbe2-4373-8edd-bcbe2c7fe54e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c6cf2f84-cc66-4313-868b-3ba22a18585e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:17Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb073c39-d98b-4005-9a17-5f9872fea192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb073c39-d98b-4005-9a17-5f9872fea192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86d6e0d-5cd6-4028-811a-a597c02fddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86d6e0d-5cd6-4028-811a-a597c02fddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9d92220-dbe2-4373-8edd-bcbe2c7fe54e', 'volume_name': 'volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e', 'volume_size': 2, 'snapshot_id': 'c6cf2f84-cc66-4313-868b-3ba22a18585e'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff39a771-08dc-4d32-ad88-3fa214c47eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff39a771-08dc-4d32-ad88-3fa214c47eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734832b-14ef-408c-806f-ce424a3bd661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Volume e9d92220-dbe2-4373-8edd-bcbe2c7fe54e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e', 'volume_size': 2, 'snapshot_id': 'c6cf2f84-cc66-4313-868b-3ba22a18585e'} Nov 02 09:43:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-861468e6-85fd-4cf0-a4d3-ce5aafa67dc3 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Created volume successfully. Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Creating volume e9d92220-dbe2-4373-8edd-bcbe2c7fe54e from snapshot c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] snapshot: c6cf2f84-cc66-4313-868b-3ba22a18585e, volume: e9d92220-dbe2-4373-8edd-bcbe2c7fe54e, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee86c6-8a00-4e58-9da0-b36c3d88fb06]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:17 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:17 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:18 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 0.794s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a08953-d037-4cf9-80f1-25c622b727f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:43:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d88802-e577-426f-8f61-6258eed58f20]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:18 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:18 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:19 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.798s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:43:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:43:19 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:43:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:19 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e Nov 02 09:43:19 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1104ce20-4fe4-44cf-a677-e5d32b1bdb47 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" by "attach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1104ce20-4fe4-44cf-a677-e5d32b1bdb47 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" acquired by "attach_volume" :: waited 0.073s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1104ce20-4fe4-44cf-a677-e5d32b1bdb47 tempest-VolumesActionsTest-1390322316 None] Attaching volume 512e1d4b-5061-48a3-be29-705f38e3fd9c to instance cb1454ae-867d-4b7a-838b-b01d46234564 at mountpoint /dev/vdb on host None. Nov 02 09:43:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1104ce20-4fe4-44cf-a677-e5d32b1bdb47 tempest-VolumesActionsTest-1390322316 None] Attach volume completed successfully. Nov 02 09:43:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1104ce20-4fe4-44cf-a677-e5d32b1bdb47 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c" released by "attach_volume" :: held 0.395s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Acquiring lock "cinder-1253e19f-e93a-43b4-a6e1-8d451ef93c11-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "cinder-1253e19f-e93a-43b4-a6e1-8d451ef93c11-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Acquiring lock "cinder-quobyte-1253e19f-e93a-43b4-a6e1-8d451ef93c11" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "cinder-quobyte-1253e19f-e93a-43b4-a6e1-8d451ef93c11" acquired by "delete_volume" :: waited 0.076s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8f468a-c9d5-41f2-96fc-525165073599]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:22 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 Nov 02 09:43:22 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-94b11827-3729-4cee-9085-da3ccd8c15e2 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" by "detach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-94b11827-3729-4cee-9085-da3ccd8c15e2 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-94b11827-3729-4cee-9085-da3ccd8c15e2 tempest-VolumesActionsTest-1390322316 None] Detaching volume 512e1d4b-5061-48a3-be29-705f38e3fd9c from instance cb1454ae-867d-4b7a-838b-b01d46234564. Nov 02 09:43:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-94b11827-3729-4cee-9085-da3ccd8c15e2 tempest-VolumesActionsTest-1390322316 None] Detach volume completed successfully. Nov 02 09:43:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-94b11827-3729-4cee-9085-da3ccd8c15e2 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:23 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11" returned: 0 in 1.156s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:23 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11 Nov 02 09:43:23 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:24 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1253e19f-e93a-43b4-a6e1-8d451ef93c11" returned: 0 in 0.885s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "cinder-quobyte-1253e19f-e93a-43b4-a6e1-8d451ef93c11" released by "delete_volume" :: held 2.229s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Created reservations ['40b00576-9e22-494d-bf71-c8d923c867b7', '5181dff1-60f5-4627-b88f-4821f69b3c95', '1a78bac9-8dfd-4037-b529-b72f5dbe2a01', '0401f4fe-698a-4fcf-b664-2da0f11f52e4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:25 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:43:25 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:25 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.530s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:43:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Deleted volume successfully. Nov 02 09:43:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f9a36e85-bed4-4c7f-b228-7fe176aec790 tempest-VolumeQuotasNegativeTestJSON-581954162 None] Lock "cinder-1253e19f-e93a-43b4-a6e1-8d451ef93c11-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:29 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" returned: 0 in 10.867s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:29 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9, size 1024.00 MB, duration 10.87 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:43:29 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Converted 1024.00 MB image at 94.22 MB/s Nov 02 09:43:29 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e is being set with open permissions: ugo+rw Nov 02 09:43:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:30 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e Nov 02 09:43:30 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:30 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" released by "_copy_volume_from_snapshot" :: held 12.996s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" released by "_create_volume_from_snapshot" :: held 13.081s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.102s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734832b-14ef-408c-806f-ce424a3bd661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e', 'volume_size': 2, 'snapshot_id': 'c6cf2f84-cc66-4313-868b-3ba22a18585e'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9bd14-94eb-4c07-800e-097bee2f52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:30 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Volume volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e (e9d92220-dbe2-4373-8edd-bcbe2c7fe54e): created successfully Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abc9bd14-94eb-4c07-800e-097bee2f52f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (60cdb7ee-a17c-4aad-b9fe-b0bd75daf368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e77579ac-7838-4abb-ad00-6c5783198d0d tempest-VolumesSnapshotTestJSON-916430247 None] Created volume successfully. Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b12b6-b6c0-4640-aaa1-3bd2f3566c99]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:31 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e Nov 02 09:43:31 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:31 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" returned: 0 in 0.588s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:31 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e Nov 02 09:43:31 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:32 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" returned: 0 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e" released by "delete_volume" :: held 1.096s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['aae987a3-5cb1-4976-8e68-3e7434153e8f', 'c429a771-53e1-44a6-ac3e-c8eb9d03999d', '72fbea8e-91b4-4405-9b0a-e16c67ffb5d9', 'fb7142fb-5185-4153-8b24-8eaf708a20e4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:32 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:43:32 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:32 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:43:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Deleted volume successfully. Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9af4284d-0c26-4d2c-8830-54b4e3921b66 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-e9d92220-dbe2-4373-8edd-bcbe2c7fe54e-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaeb202-a11c-420f-8725-2bdd38453fbd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:33 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:43:33 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:33 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.411s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d78fa-f4e1-46e3-ba8e-f69950dd06ea]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-c6cf2f84-cc66-4313-868b-3ba22a18585e-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-c6cf2f84-cc66-4313-868b-3ba22a18585e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Deleting offline snapshot c6cf2f84-cc66-4313-868b-3ba22a18585e of volume 92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:43:33 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:43:33 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] snapshot_file for this snap is: volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465dc60-9c05-41a6-9c63-4daa6c7a885d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:33 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:33 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:34 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.589s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.6b761adc-51c5-452f-8115-d6ce43fa227632ibfdag.img {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:34 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.6b761adc-51c5-452f-8115-d6ce43fa227632ibfdag.img Nov 02 09:43:34 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:34 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 0.534s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92a08953-d037-4cf9-80f1-25c622b727f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0986c3dc-41c3-4845-b276-80962d337e16]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:34 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:34 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:35 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.912s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:35 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:35 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:36 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 1.320s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:36 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e Nov 02 09:43:36 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:37 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9.c6cf2f84-cc66-4313-868b-3ba22a18585e" returned: 0 in 0.749s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c6cf2f84-cc66-4313-868b-3ba22a18585e" released by "_delete_snapshot" :: held 3.809s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" released by "delete_snapshot" :: held 3.869s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:37 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['494cd302-e1cd-4df9-8f6e-a58672f4692d', '499a7296-2035-45fa-a093-266ae2539600', '89b1a74c-0e9a-4766-8782-54d0b38ba0c5', '4d0ae502-0de0-4ad7-8a11-3081972bd803'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:43:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Delete snapshot completed successfully. Nov 02 09:43:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2963065-79b2-40a6-b154-b385bc8ad6bf tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-c6cf2f84-cc66-4313-868b-3ba22a18585e-delete_snapshot" released by "delete_snapshot" :: held 4.308s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-92a08953-d037-4cf9-80f1-25c622b727f9-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-92a08953-d037-4cf9-80f1-25c622b727f9-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" acquired by "delete_volume" :: waited 0.054s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[54206cad-36d3-4fa3-96ea-92e170a20c22]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:39 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:39 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:39 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.930s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:39 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9 Nov 02 09:43:39 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:40 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92a08953-d037-4cf9-80f1-25c622b727f9" returned: 0 in 0.962s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-92a08953-d037-4cf9-80f1-25c622b727f9" released by "delete_volume" :: held 2.230s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['9d8daabc-53f0-4291-8a18-5a771135dbd9', '1310ab41-4067-44bc-ab26-e340024a28e3', '287b1952-28fc-418a-8efa-f895deb43513', '4e85cca1-7ad2-466e-a0fe-e819c11baddd'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:41 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:43:41 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:41 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.504s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:43:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Deleted volume successfully. Nov 02 09:43:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a9c7985-088d-4a04-86d7-82e8ac088586 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-92a08953-d037-4cf9-80f1-25c622b727f9-delete_volume" released by "delete_volume" :: held 3.534s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (351bef99-6be6-4e86-b71d-bbce765d4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec81e5-3901-4b23-895e-53b1b2793cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec81e5-3901-4b23-895e-53b1b2793cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-205550225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995ec9a4-e500-48f3-b770-1c3dfea1c9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:43Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fcccd5-afea-403b-b6f7-4690b9debc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fcccd5-afea-403b-b6f7-4690b9debc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe00ce5-cfd2-4eec-b95c-8b4627835a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe00ce5-cfd2-4eec-b95c-8b4627835a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995ec9a4-e500-48f3-b770-1c3dfea1c9cb', 'volume_name': 'volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29482285-223a-4778-8899-39e2a3883596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29482285-223a-4778-8899-39e2a3883596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d21242a-7daf-47ec-85e7-2715a7611d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:43 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Volume 995ec9a4-e500-48f3-b770-1c3dfea1c9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb', 'volume_size': 1} Nov 02 09:43:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:45 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.6b761adc-51c5-452f-8115-d6ce43fa227632ibfdag.img" returned: 0 in 11.247s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed37265d-474d-40a2-8f76-92c137221d22]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:43:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:45 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:43:45 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:45 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.699s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:46 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c, size 1024.00 MB, duration 11.25 sec, destination /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.6b761adc-51c5-452f-8115-d6ce43fa227632ibfdag.img {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:43:46 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Converted 1024.00 MB image at 91.04 MB/s Nov 02 09:43:46 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] 6b761adc-51c5-452f-8115-d6ce43fa2276 was raw, no need to convert to raw {{(pid=86887) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Flow 'volume_create_manager' (3a487aca-d985-48c4-8f85-2e0cd20e1350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a276f62-34aa-489e-876f-4bccb1c7d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a276f62-34aa-489e-876f-4bccb1c7d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1066570517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbbbd0c-9fd7-4f00-978a-272c898a7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3f83c7486243a889e88ec946c52095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:51Z,use_quota=True,user_id='8697026cf13940d9ab798b9929480518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5ee7d0d-6d7b-4325-b7ff-dedaffebaf2b),volume_type_id=e5ee7d0d-6d7b-4325-b7ff-dedaffebaf2b)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93b6c5d-5d26-4f46-a59a-f2eb33dfa64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93b6c5d-5d26-4f46-a59a-f2eb33dfa64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2806ff49-ed91-45e1-bfb8-ff90a1ecba95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2806ff49-ed91-45e1-bfb8-ff90a1ecba95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbbbbd0c-9fd7-4f00-978a-272c898a7120', 'volume_name': 'volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f9a968-bab5-42ba-96ff-d4947f5f1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f9a968-bab5-42ba-96ff-d4947f5f1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175778f0-fa1b-40a7-bb91-bc62409b47d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:43:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Volume fbbbbd0c-9fd7-4f00-978a-272c898a7120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120', 'volume_size': 1} Nov 02 09:43:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:43:58 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:43:58 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:43:58 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.285s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 28 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:43:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:44:00 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=71,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:44:00 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=57,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (80ff83ff-e5aa-4042-be3d-510530aa3c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32372daf-37b6-4e0c-8587-e7efddec238f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32372daf-37b6-4e0c-8587-e7efddec238f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98994354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7241cc2-6bd6-4288-b79a-6a514e485c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:05Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02706e-8a12-4fcd-a940-47ef68d68092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb02706e-8a12-4fcd-a940-47ef68d68092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee862e19-d170-4e7f-ab4d-58dd8c37d988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee862e19-d170-4e7f-ab4d-58dd8c37d988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7241cc2-6bd6-4288-b79a-6a514e485c20', 'volume_name': 'volume-f7241cc2-6bd6-4288-b79a-6a514e485c20', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e588642f-b539-435c-b088-b733282d58d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e588642f-b539-435c-b088-b733282d58d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a81dc17-40be-4b99-861a-d5513758855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Volume f7241cc2-6bd6-4288-b79a-6a514e485c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7241cc2-6bd6-4288-b79a-6a514e485c20', 'volume_size': 1} Nov 02 09:44:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.447s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Uploaded volume to glance image-id: 6b761adc-51c5-452f-8115-d6ce43fa2276. {{(pid=86887) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.461s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-205550225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995ec9a4-e500-48f3-b770-1c3dfea1c9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:43Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Creating volume 995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:07 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:07 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb 1073741824 Nov 02 09:44:07 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d5d78547-6fec-4381-a2de-f13282614feb tempest-VolumesActionsTest-1390322316 None] Copy volume to image completed successfully. Nov 02 09:44:07 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb 1073741824" returned: 0 in 0.453s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:07 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:07 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:08 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 0.248s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.321s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1066570517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbbbbd0c-9fd7-4f00-978a-272c898a7120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a3f83c7486243a889e88ec946c52095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:43:51Z,use_quota=True,user_id='8697026cf13940d9ab798b9929480518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5ee7d0d-6d7b-4325-b7ff-dedaffebaf2b),volume_type_id=e5ee7d0d-6d7b-4325-b7ff-dedaffebaf2b)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Creating volume fbbbbd0c-9fd7-4f00-978a-272c898a7120 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:08 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d21242a-7daf-47ec-85e7-2715a7611d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed198d4-f72d-480e-a574-1442b01e6e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:08 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 1073741824 Nov 02 09:44:08 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Volume volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb (995ec9a4-e500-48f3-b770-1c3dfea1c9cb): created successfully Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed198d4-f72d-480e-a574-1442b01e6e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (351bef99-6be6-4e86-b71d-bbce765d4400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9501aadb-4885-48a2-bec8-023a5b00df2d tempest-VolumesSnapshotTestJSON-916430247 None] Created volume successfully. Nov 02 09:44:08 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 1073741824" returned: 0 in 0.479s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:08 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 Nov 02 09:44:08 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:08 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120" returned: 0 in 0.282s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.422s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98994354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7241cc2-6bd6-4288-b79a-6a514e485c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:05Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Creating volume f7241cc2-6bd6-4288-b79a-6a514e485c20 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:09 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175778f0-fa1b-40a7-bb91-bc62409b47d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:09 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 1073741824 Nov 02 09:44:09 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f355ce3-24dd-4fdf-bdf6-afe7ab69ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:09 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Volume volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 (fbbbbd0c-9fd7-4f00-978a-272c898a7120): created successfully Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f355ce3-24dd-4fdf-bdf6-afe7ab69ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Flow 'volume_create_manager' (3a487aca-d985-48c4-8f85-2e0cd20e1350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1b92fadc-64d3-4c24-9cbe-73139e94eab6 tempest-VolumeTypesAccessTest-2016011250 None] Created volume successfully. Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:09 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 1073741824" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:09 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 Nov 02 09:44:09 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:09 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.810s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a81dc17-40be-4b99-861a-d5513758855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7241cc2-6bd6-4288-b79a-6a514e485c20', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71192b4b-6f27-4f6c-815f-f891416ab878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8e0e65-2ade-4c12-8bde-465f518655a2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:09 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Volume volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 (f7241cc2-6bd6-4288-b79a-6a514e485c20): created successfully Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71192b4b-6f27-4f6c-815f-f891416ab878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (80ff83ff-e5aa-4042-be3d-510530aa3c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-43d0bcb3-83b6-41c3-bb4f-3945498bc240 tempest-AttachVolumeNegativeTest-730544798 None] Created volume successfully. Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Acquiring lock "cinder-fbbbbd0c-9fd7-4f00-978a-272c898a7120-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:09 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:44:09 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "cinder-fbbbbd0c-9fd7-4f00-978a-272c898a7120-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Acquiring lock "cinder-quobyte-fbbbbd0c-9fd7-4f00-978a-272c898a7120" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "cinder-quobyte-fbbbbd0c-9fd7-4f00-978a-272c898a7120" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8faee8-ef16-4d28-bef9-97433cb2eb23]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:10 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 Nov 02 09:44:10 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:10 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.393s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c338b29-319f-4415-bed2-b0fb2b100db7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:10 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:44:10 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:10 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120" returned: 0 in 0.391s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:10 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120 Nov 02 09:44:10 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:10 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.372s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:10 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img Nov 02 09:44:10 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:10 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fbbbbd0c-9fd7-4f00-978a-272c898a7120" returned: 0 in 0.265s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "cinder-quobyte-fbbbbd0c-9fd7-4f00-978a-272c898a7120" released by "delete_volume" :: held 0.715s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:10 devstack cinder-volume[86887]: WARNING cinder.quota [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-633186649 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-633186649, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:44:10 devstack cinder-volume[86887]: WARNING cinder.quota [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-633186649 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-633186649, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Created reservations ['fdf1ddd9-b83c-486c-93c6-223bd1382307', 'b7d9f27b-aecc-4202-a0f7-d1c30bd97a27', '99623ca9-bf7e-48b8-aa4c-3f6297e34954', 'f93aa31c-e448-4ba5-9b17-e0857b03363c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:10 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:10 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:11 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.459s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:11 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Deleted volume successfully. Nov 02 09:44:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5ca927c4-0de0-4a7b-b0c5-4aa8d2c626fd tempest-VolumeTypesAccessTest-2016011250 None] Lock "cinder-fbbbbd0c-9fd7-4f00-978a-272c898a7120-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ac4d86dd-627a-4a26-8fac-06cdd79041ac req-3fe16004-3fd5-41fc-9108-8c0dcd8ea7bd tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:17 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img" returned: 0 in 7.080s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:17 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ab1f3e-717b-4cb8-8d90-c2196c9bc6a7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:17 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:44:17 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:18 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.554s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:44:18 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Converted 1024.00 MB image at 144.60 MB/s Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] 89d0c264-fec1-4495-b9dd-b4437b38a85b was raw, converting to qcow2 {{(pid=86887) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1418aea7-fc1f-478c-8714-d0c770e4fada]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:18 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img Nov 02 09:44:18 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:18 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:18 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img Nov 02 09:44:18 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:19 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img" returned: 1 in 0.335s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img /opt/stack/data/cinder/conversion/vol_upload_ncsel21x {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:19 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img /opt/stack/data/cinder/conversion/vol_upload_ncsel21x Nov 02 09:44:19 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:19 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img /opt/stack/data/cinder/conversion/vol_upload_ncsel21x" returned: 0 in 0.265s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Image conversion details: src /opt/stack/data/cinder/conversion/512e1d4b-5061-48a3-be29-705f38e3fd9c.temp_image.89d0c264-fec1-4495-b9dd-b4437b38a85bavlu82kd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ncsel21x {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:44:19 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[178e3c5a-df07-4a2a-a536-da9228b89c7b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ncsel21x {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:19 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ncsel21x Nov 02 09:44:19 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:19 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ncsel21x" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.439s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Uploaded volume to glance image-id: 89d0c264-fec1-4495-b9dd-b4437b38a85b. {{(pid=86887) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.837s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Creating offline snapshot dffa278d-9cd0-43a8-b7f5-faac9e5fec0d of volume 995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:44:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b835b3bc-8b74-4366-862c-b4c6b4062c0c tempest-VolumesActionsTest-1390322316 None] Copy volume to image completed successfully. Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e777c6e-51ae-4c9b-9da2-02413759430d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:21 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:21 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:21 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 0.472s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:21 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d 1G Nov 02 09:44:21 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:22 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d 1G" returned: 0 in 0.622s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:22 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:22 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "cinder-quobyte-512e1d4b-5061-48a3-be29-705f38e3fd9c" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-quobyte-512e1d4b-5061-48a3-be29-705f38e3fd9c" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48aec38-6e8b-49e5-8658-af8a88e1de79]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:22 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.371s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:22 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d is being set with open permissions: ugo+rw Nov 02 09:44:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:22 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:22 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:22 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:44:22 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:23 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:23 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c Nov 02 09:44:23 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:23 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info Nov 02 09:44:23 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:23 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-512e1d4b-5061-48a3-be29-705f38e3fd9c" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-quobyte-512e1d4b-5061-48a3-be29-705f38e3fd9c" released by "delete_volume" :: held 0.795s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info" returned: 0 in 0.296s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info is being set with open permissions: ugo+rw Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:23 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info Nov 02 09:44:23 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Created reservations ['351a35c4-655b-4cac-bf0d-c472d0ef163e', 'b3e9b0fb-af90-467d-9659-412f00508442', '49f87949-724d-48e6-b01f-b6dfb5d46609', '92974f3c-3a52-400f-9764-3aa1ca85793e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:23 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:23 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:23 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.info" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ac4d86dd-627a-4a26-8fac-06cdd79041ac req-3fe16004-3fd5-41fc-9108-8c0dcd8ea7bd tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.430s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ac4d86dd-627a-4a26-8fac-06cdd79041ac req-3fe16004-3fd5-41fc-9108-8c0dcd8ea7bd tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5e55c3d7-46e2-41ee-9358-72c86313caf3 tempest-VolumesSnapshotTestJSON-916430247 None] Create snapshot completed successfully Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-ac4d86dd-627a-4a26-8fac-06cdd79041ac req-3fe16004-3fd5-41fc-9108-8c0dcd8ea7bd tempest-AttachVolumeNegativeTest-730544798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-f7241cc2-6bd6-4288-b79a-6a514e485c20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '519e15aa-ce44-4cc8-b583-de7ae78cadbc', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:44:23 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.328s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:23 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-ac4d86dd-627a-4a26-8fac-06cdd79041ac req-3fe16004-3fd5-41fc-9108-8c0dcd8ea7bd tempest-AttachVolumeNegativeTest-730544798 None] attachment_update completed successfully. Nov 02 09:44:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Deleted volume successfully. Nov 02 09:44:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2758565f-3c91-4fe4-bfd0-c73d2e6423b9 tempest-VolumesActionsTest-1390322316 None] Lock "cinder-512e1d4b-5061-48a3-be29-705f38e3fd9c-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (91912db5-5521-4af4-b436-cc221f733aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fed2b3-51c5-4b48-bc9f-b65c66b3b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24fed2b3-51c5-4b48-bc9f-b65c66b3b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1055450032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48f7a0a-e696-4d94-8ecc-df9fcf57fc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2954d666db7455195c71ffad70ace24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dffa278d-9cd0-43a8-b7f5-faac9e5fec0d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:25Z,use_quota=True,user_id='b28ace2c305842fc9c80bc3495d69053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414043de-ab72-4b19-be8a-68dc1a08b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414043de-ab72-4b19-be8a-68dc1a08b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6c2827-e623-4dd7-b3f7-f518ac14b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6c2827-e623-4dd7-b3f7-f518ac14b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c48f7a0a-e696-4d94-8ecc-df9fcf57fc76', 'volume_name': 'volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76', 'volume_size': 1, 'snapshot_id': 'dffa278d-9cd0-43a8-b7f5-faac9e5fec0d'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d85cf-7031-49a7-ae9b-b14b678d0cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1d85cf-7031-49a7-ae9b-b14b678d0cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cbc32a-6b34-474e-8097-f64fe40283c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Volume c48f7a0a-e696-4d94-8ecc-df9fcf57fc76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76', 'volume_size': 1, 'snapshot_id': 'dffa278d-9cd0-43a8-b7f5-faac9e5fec0d'} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Creating volume c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 from snapshot dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] snapshot: dffa278d-9cd0-43a8-b7f5-faac9e5fec0d, volume: c48f7a0a-e696-4d94-8ecc-df9fcf57fc76, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73d1e5-e3d4-4cd8-89a7-713f21b5ae38]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:25 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:25 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:26 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.443s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc30327e-731a-491b-b0de-e4aec9133b37]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:26 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:26 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:26 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 0.542s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:44:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:26 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 Nov 02 09:44:26 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:44:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=34,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:44:35 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" returned: 0 in 9.104s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:35 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb, size 1024.00 MB, duration 9.10 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:44:35 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Converted 1024.00 MB image at 112.47 MB/s Nov 02 09:44:35 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 is being set with open permissions: ugo+rw Nov 02 09:44:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:35 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 Nov 02 09:44:35 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:36 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" returned: 0 in 0.433s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" released by "_copy_volume_from_snapshot" :: held 10.668s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" released by "_create_volume_from_snapshot" :: held 10.794s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.828s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cbc32a-6b34-474e-8097-f64fe40283c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76', 'volume_size': 1, 'snapshot_id': 'dffa278d-9cd0-43a8-b7f5-faac9e5fec0d'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf9bcb-227d-4335-8134-b0728b2c010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:36 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Volume volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 (c48f7a0a-e696-4d94-8ecc-df9fcf57fc76): created successfully Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfdf9bcb-227d-4335-8134-b0728b2c010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Flow 'volume_create_manager' (91912db5-5521-4af4-b436-cc221f733aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-443afbb9-9d37-4ab9-b33e-ca9c8d32018e tempest-VolumesSnapshotTestJSON-916430247 None] Created volume successfully. Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:37 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6c54c6-c35a-4280-b264-40e026fff6be]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:37 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 Nov 02 09:44:37 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:37 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" returned: 0 in 0.579s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:37 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76 Nov 02 09:44:37 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:37 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76" released by "delete_volume" :: held 1.019s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['2b9dd074-aef0-4e06-85d3-17cc92fb0259', '4261d33c-fa7d-499a-94ed-b54d4fce280a', '45a48d67-b05c-49e8-9289-be2e2a0d8690', 'cd0f721d-067e-48ad-a7d4-a7c8e4edd929'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:38 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:38 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Flow 'volume_create_manager' (29969a7c-6a3c-4832-a465-0de2957fb723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28292a44-01c8-4c53-b4e1-bc9e7ffeac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28292a44-01c8-4c53-b4e1-bc9e7ffeac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1978566783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794d26a1-17c4-4b40-8666-eeb2f305949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4bda68290a448ea506dcc2e7678dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:38Z,use_quota=True,user_id='31668ce721464837800893b4d44dfd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d34cb4-144c-46a3-ad3c-07edaad765ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d34cb4-144c-46a3-ad3c-07edaad765ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8ec9b1-d32f-48ef-8869-d975d5a15bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8ec9b1-d32f-48ef-8869-d975d5a15bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794d26a1-17c4-4b40-8666-eeb2f305949a', 'volume_name': 'volume-794d26a1-17c4-4b40-8666-eeb2f305949a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfc4059-e4ac-4455-b2b7-84a182d50604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfc4059-e4ac-4455-b2b7-84a182d50604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3dc395-358e-4915-8bd5-258dad10f16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Volume 794d26a1-17c4-4b40-8666-eeb2f305949a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794d26a1-17c4-4b40-8666-eeb2f305949a', 'volume_size': 1} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1978566783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794d26a1-17c4-4b40-8666-eeb2f305949a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4bda68290a448ea506dcc2e7678dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:38Z,use_quota=True,user_id='31668ce721464837800893b4d44dfd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Creating volume 794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:38 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:38 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a 1073741824 Nov 02 09:44:38 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:44:38 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Flow 'volume_create_manager' (4d73ccdf-e573-4f6c-a8ea-8b201a49518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93315fa5-f4fa-4d75-85c9-f6d502920f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.328s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93315fa5-f4fa-4d75-85c9-f6d502920f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-52951426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f614aa2a-8bf2-4e45-9881-e9ec3eb8572c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bc570d9c6a4111835f2009a1a0c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:38Z,use_quota=True,user_id='7f8118dc062d440b8d83b13a85b63c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e22236-b325-4524-aac7-fc6478e3956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e22236-b325-4524-aac7-fc6478e3956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d253d1a-e977-4d25-b1be-625441e26ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:44:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Deleted volume successfully. Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6e4cc248-6023-470c-90fe-90068b17b68f tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-c48f7a0a-e696-4d94-8ecc-df9fcf57fc76-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d253d1a-e977-4d25-b1be-625441e26ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f614aa2a-8bf2-4e45-9881-e9ec3eb8572c', 'volume_name': 'volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd9e1e8-8841-4ef2-a530-5d716d1572a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd9e1e8-8841-4ef2-a530-5d716d1572a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef434930-85c6-406a-af50-268e91ace029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:38 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 09:44:38 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Trying to clone f614aa2a-8bf2-4e45-9881-e9ec3eb8572c from image e2facddb-b106-4022-8544-580b8fc5acbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:44:39 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a 1073741824" returned: 0 in 0.620s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:39 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:44:39 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:39 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.343s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Deleting offline snapshot dffa278d-9cd0-43a8-b7f5-faac9e5fec0d of volume 995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] snapshot_file for this snap is: volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f6cb0e-ffd4-4d92-bdaf-6027213bcaf5]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3dc395-358e-4915-8bd5-258dad10f16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794d26a1-17c4-4b40-8666-eeb2f305949a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb5101a-cbb5-4580-aa59-952531685884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:44:39 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Image download 20.69 MB at 20.69 MB/s Nov 02 09:44:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Volume volume-794d26a1-17c4-4b40-8666-eeb2f305949a (794d26a1-17c4-4b40-8666-eeb2f305949a): created successfully Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb5101a-cbb5-4580-aa59-952531685884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Flow 'volume_create_manager' (29969a7c-6a3c-4832-a465-0de2957fb723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:39 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1a74ab79-4cda-44c4-b0ab-fc4500a5d466 tempest-VolumesCloneTest-1920720424 None] Created volume successfully. Nov 02 09:44:39 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:39 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b57e2-f819-4780-a35c-eb34d3cef270]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:39 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD Nov 02 09:44:39 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:40 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.612s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4704b7-9432-4588-83d1-05375daca7f7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:40 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD" returned: 0 in 0.584s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd is fetched for user 7f8118dc062d440b8d83b13a85b63c75. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:44:40 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:40 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e03aaa9-8c28-4ba2-8ed5-2077f0365b65]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:40 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD Nov 02 09:44:40 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:41 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD" returned: 0 in 0.703s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-52951426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f614aa2a-8bf2-4e45-9881-e9ec3eb8572c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31bc570d9c6a4111835f2009a1a0c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:38Z,use_quota=True,user_id='7f8118dc062d440b8d83b13a85b63c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Creating volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:44:41 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:41 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:41 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1073741824 Nov 02 09:44:41 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 1.042s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:41 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:41 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Flow 'volume_create_manager' (460974ae-7ffb-4edd-b87e-b5ba9abc7c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afd7f3a-5e92-4b10-ae35-a7d0d387382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afd7f3a-5e92-4b10-ae35-a7d0d387382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1345912695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8003da7-d191-4de5-a545-586863f4ce30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b4bda68290a448ea506dcc2e7678dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:44:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=794d26a1-17c4-4b40-8666-eeb2f305949a,status='creating',terminated_at=None,updated_at=2026-11-02T08:44:41Z,use_quota=True,user_id='31668ce721464837800893b4d44dfd4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608fa4bd-c8af-4f53-99d7-d0d672fa0920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608fa4bd-c8af-4f53-99d7-d0d672fa0920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bda3f4-1259-40e9-b5cb-922f5743e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bda3f4-1259-40e9-b5cb-922f5743e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a8003da7-d191-4de5-a545-586863f4ce30', 'volume_name': 'volume-a8003da7-d191-4de5-a545-586863f4ce30', 'volume_size': 2, 'source_volid': '794d26a1-17c4-4b40-8666-eeb2f305949a', 'source_volstatus': 'available'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6689b77c-c78d-4788-bdf4-b0cd99cfc1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6689b77c-c78d-4788-bdf4-b0cd99cfc1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b002a7-a7d1-406a-bfbc-78b439311731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:41 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Volume a8003da7-d191-4de5-a545-586863f4ce30: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a8003da7-d191-4de5-a545-586863f4ce30', 'volume_size': 2, 'source_volid': '794d26a1-17c4-4b40-8666-eeb2f305949a', 'source_volstatus': 'available'} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:41 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.535s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:41 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d Nov 02 09:44:41 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:41 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1073741824" returned: 0 in 0.714s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:42 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c Nov 02 09:44:42 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:42 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb.dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" returned: 0 in 0.366s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d" released by "_delete_snapshot" :: held 2.721s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" released by "delete_snapshot" :: held 2.767s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['6ad7a3a3-fdf0-4f07-8edc-dfe42fb840e6', '14b436a8-bc6f-450a-bab5-ffed9ddc50b2', 'a23c834e-2f88-4b9e-a6d3-6c04c8336fb4', '16603bf5-948f-432f-be62-6405abd346d2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:42 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.655s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:42 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Cloning volume 794d26a1-17c4-4b40-8666-eeb2f305949a to volume a8003da7-d191-4de5-a545-586863f4ce30 Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Attempting download of e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Creating offline snapshot 9e704424-5ad2-4022-bae3-24daeab6682e of volume 794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf3226c-0fda-4abe-b3b9-1fb6e3f0d55f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:42 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Delete snapshot completed successfully. Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c617a900-c2be-414b-999f-4345367c445c]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-216c5fa6-26d8-47fc-b853-9f4fb6d278e4 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-dffa278d-9cd0-43a8-b7f5-faac9e5fec0d-delete_snapshot" released by "delete_snapshot" :: held 3.021s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:42 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:44:42 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:42 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h Nov 02 09:44:42 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:42 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h" returned: 0 in 0.363s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-995ec9a4-e500-48f3-b770-1c3dfea1c9cb-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-995ec9a4-e500-48f3-b770-1c3dfea1c9cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:42 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.544s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:42 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h Nov 02 09:44:42 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:42 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e 1G Nov 02 09:44:42 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d443b4-7d7c-49b3-9b0f-c01bba90dbb8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:43 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h" returned: 1 in 0.469s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_7etw704h' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[71782fe9-d938-401c-9438-fbd9abb77569]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:43 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:43 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:43 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD Nov 02 09:44:43 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:43 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e 1G" returned: 0 in 0.700s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794d26a1-17c4-4b40-8666-eeb2f305949a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:43 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794d26a1-17c4-4b40-8666-eeb2f305949a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:43 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:43 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 0.616s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:43 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] e2facddb-b106-4022-8544-580b8fc5acbd was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:44:43 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb Nov 02 09:44:43 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:43 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c Nov 02 09:44:43 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:44 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-794d26a1-17c4-4b40-8666-eeb2f305949a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.505s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e is being set with open permissions: ugo+rw Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:44 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:44 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:44 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-995ec9a4-e500-48f3-b770-1c3dfea1c9cb" released by "delete_volume" :: held 1.212s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['5d298e93-772a-4c0c-8a41-b04cbd72d212', '31620846-a258-45df-8a71-992701131da2', '44f2c692-ca3e-4a38-932a-a7abab3477ad', '656e0abf-a085-45d5-aa05-c42f9c3490a9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:44 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:44 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:44 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.468s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:44 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info Nov 02 09:44:44 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:44 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.417s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Deleted volume successfully. Nov 02 09:44:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36bc06ef-52cf-4229-9b28-00309d28a830 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-995ec9a4-e500-48f3-b770-1c3dfea1c9cb-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:45 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:45 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info is being set with open permissions: ugo+rw Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:45 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info Nov 02 09:44:45 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:45 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.info" returned: 0 in 0.518s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] snapshot: 9e704424-5ad2-4022-bae3-24daeab6682e, volume: a8003da7-d191-4de5-a545-586863f4ce30, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06c3a6d-ecd5-429c-8856-7cf8260acf0e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[489ba931-a1cc-43b4-a464-1bf6781762b8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:45 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:45 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:46 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d Nov 02 09:44:46 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:46 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.539s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-794d26a1-17c4-4b40-8666-eeb2f305949a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60c637-64a1-4775-89e6-2896a4bf441b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:46 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" returned: 0 in 0.567s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:46 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d Nov 02 09:44:46 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:46 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:44:46 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:46 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.544s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:44:46 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" returned: 0 in 0.429s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:46 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 Nov 02 09:44:46 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-quobyte-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d" released by "delete_volume" :: held 1.091s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Created reservations ['f765b7b3-243f-4ac6-beaf-5a20e348dceb', 'ec9bddb1-3bac-49fb-9efd-ccac57ab805d', '37207db5-32cc-405f-91d1-fa468c907d19', '7e66c229-ff27-4d38-b89d-0940b2c5e02f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:46 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" returned: 0 in 3.186s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_ictgzik3devstack@QuobyteHD, size 112.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:44:46 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Converted 112.00 MB image at 35.14 MB/s Nov 02 09:44:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:47 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1G Nov 02 09:44:47 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:47 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:47 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:47 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.295s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Deleted volume successfully. Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d4cc3a8-0788-42e3-9ae3-51f4498b3d16 tempest-VolumesSnapshotTestJSON-916430247 None] Lock "cinder-539bfee6-ba43-4ac4-b5ea-196c5d52ca8d-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:47 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c 1G" returned: 0 in 0.572s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Downloaded image e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd for user 7f8118dc062d440b8d83b13a85b63c75 is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Marking volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Copying metadata from image e2facddb-b106-4022-8544-580b8fc5acbd to f614aa2a-8bf2-4e45-9881-e9ec3eb8572c. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Creating volume glance metadata for volume f614aa2a-8bf2-4e45-9881-e9ec3eb8572c backed by image e2facddb-b106-4022-8544-580b8fc5acbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef434930-85c6-406a-af50-268e91ace029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84268ce-2ff4-4c37-920c-851391a9eb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Volume volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c (f614aa2a-8bf2-4e45-9881-e9ec3eb8572c): created successfully Nov 02 09:44:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84268ce-2ff4-4c37-920c-851391a9eb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Flow 'volume_create_manager' (4d73ccdf-e573-4f6c-a8ea-8b201a49518e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d245b054-ef9d-4e1f-9067-a12434a1a58d tempest-VolumesImageMetadata-1413618031 None] Created volume successfully. Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Acquiring lock "cinder-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "cinder-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Acquiring lock "cinder-quobyte-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "cinder-quobyte-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f0178-4b43-4ae0-a7f0-a982f2f477ef]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:50 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c Nov 02 09:44:50 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:51 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" returned: 0 in 0.892s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:51 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c Nov 02 09:44:51 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:52 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" returned: 0 in 0.765s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "cinder-quobyte-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c" released by "delete_volume" :: held 1.809s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Created reservations ['56e96780-80e9-4858-83da-2bd64c940f1f', 'fc155bdb-e85b-4096-90f4-bde8a37566ef', '695c385d-c6f1-42d1-aae5-2be25c794921', 'e802725c-b7d2-46b8-bef4-7531e5de2415'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:52 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:52 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:53 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.849s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:53 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Deleted volume successfully. Nov 02 09:44:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a33ffba6-688c-44f6-8560-25dd573af258 tempest-VolumesImageMetadata-1413618031 None] Lock "cinder-f614aa2a-8bf2-4e45-9881-e9ec3eb8572c-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:56 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30" returned: 0 in 10.002s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:56 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a, size 1024.00 MB, duration 10.01 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:44:56 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Converted 1024.00 MB image at 102.35 MB/s Nov 02 09:44:56 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 is being set with open permissions: ugo+rw Nov 02 09:44:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:56 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 Nov 02 09:44:56 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:57 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" released by "_copy_volume_from_snapshot" :: held 11.584s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-quobyte-9e704424-5ad2-4022-bae3-24daeab6682e" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-9e704424-5ad2-4022-bae3-24daeab6682e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Deleting offline snapshot 9e704424-5ad2-4022-bae3-24daeab6682e of volume 794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] snapshot_file for this snap is: volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbade59-2eea-4611-9a42-d002056c77a6]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:57 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:57 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:57 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-794d26a1-17c4-4b40-8666-eeb2f305949a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc5b63-5c1d-4c84-ad26-fa22e9ab9926]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:44:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:58 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:44:58 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:58 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:44:58 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:58 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.396s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:44:58 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.727s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:58 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:58 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:59 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:44:59 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e Nov 02 09:44:59 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:44:59 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a.9e704424-5ad2-4022-bae3-24daeab6682e" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-9e704424-5ad2-4022-bae3-24daeab6682e" released by "_delete_snapshot" :: held 2.049s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.130s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28b002a7-a7d1-406a-bfbc-78b439311731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8003da7-d191-4de5-a545-586863f4ce30', 'volume_size': 2, 'source_volid': '794d26a1-17c4-4b40-8666-eeb2f305949a', 'source_volstatus': 'available'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7401bb82-1010-4b81-9d42-6116b0aec0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:44:59 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Volume volume-a8003da7-d191-4de5-a545-586863f4ce30 (a8003da7-d191-4de5-a545-586863f4ce30): created successfully Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7401bb82-1010-4b81-9d42-6116b0aec0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:44:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Flow 'volume_create_manager' (460974ae-7ffb-4edd-b87e-b5ba9abc7c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:44:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4dd173ba-c5b8-487e-9d29-8cdac899f6d7 tempest-VolumesCloneTest-1920720424 None] Created volume successfully. Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-a8003da7-d191-4de5-a545-586863f4ce30-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-a8003da7-d191-4de5-a545-586863f4ce30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Flow 'volume_create_manager' (a8139cec-ac01-4871-abff-8582ce26ead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e443f89-2853-401f-b9e5-4628445f560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e443f89-2853-401f-b9e5-4628445f560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-863660297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0d4145-1cc2-47c4-bc38-fdd2edd9f705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a80c55bf194df4a6ca4a8cc0f0a0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:00Z,use_quota=True,user_id='50f9435ea16e481db73126520c3fccc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a01b096-be5a-4134-8f0e-a29ce5222b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a01b096-be5a-4134-8f0e-a29ce5222b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbf4138-ce43-47cf-a294-6a6b52120de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbf4138-ce43-47cf-a294-6a6b52120de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0d4145-1cc2-47c4-bc38-fdd2edd9f705', 'volume_name': 'volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9e66d-dd80-40ba-83bf-f5538793d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9e66d-dd80-40ba-83bf-f5538793d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2989d71-554f-4b9d-91fb-9eb0ef116462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:00 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Volume 5c0d4145-1cc2-47c4-bc38-fdd2edd9f705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705', 'volume_size': 1} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-863660297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0d4145-1cc2-47c4-bc38-fdd2edd9f705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a80c55bf194df4a6ca4a8cc0f0a0e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:00Z,use_quota=True,user_id='50f9435ea16e481db73126520c3fccc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Creating volume 5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:00 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:00 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 1073741824 Nov 02 09:45:00 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b7d16c-8206-4f6e-b8d8-58d8715537e7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:00 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 Nov 02 09:45:00 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:00 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:00 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30 Nov 02 09:45:00 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:00 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 1073741824" returned: 0 in 0.532s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:00 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 Nov 02 09:45:00 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:00 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a8003da7-d191-4de5-a545-586863f4ce30" returned: 0 in 0.276s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-a8003da7-d191-4de5-a545-586863f4ce30" released by "delete_volume" :: held 0.773s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:01 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2989d71-554f-4b9d-91fb-9eb0ef116462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87608381-46b3-4eaf-a1ca-c5eddf67a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Created reservations ['50cd4bda-0911-4900-ae38-2cfe10ab738a', 'f76a7db0-44a0-4f29-b1f5-65e9bc124de2', '42ec9e1b-75bb-4659-b3ca-5997dc2431bd', '49db42ba-5d77-4b5b-b822-14f88cfb20dd'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Volume volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 (5c0d4145-1cc2-47c4-bc38-fdd2edd9f705): created successfully Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87608381-46b3-4eaf-a1ca-c5eddf67a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Flow 'volume_create_manager' (a8139cec-ac01-4871-abff-8582ce26ead0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-da0d4e1d-7ac9-49e8-894d-6751af73bbb3 tempest-SnapshotMetadataTestJSON-894442572 None] Created volume successfully. Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:01 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:01 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-794d26a1-17c4-4b40-8666-eeb2f305949a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "cinder-794d26a1-17c4-4b40-8666-eeb2f305949a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Acquiring lock "cinder-quobyte-794d26a1-17c4-4b40-8666-eeb2f305949a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-794d26a1-17c4-4b40-8666-eeb2f305949a" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb408d-2090-4fb3-947a-7f656763e49e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:01 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Deleted volume successfully. Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-acd70e86-8f16-4e54-aa5a-2b9159c255e6 tempest-VolumesCloneTest-1920720424 None] Lock "cinder-a8003da7-d191-4de5-a545-586863f4ce30-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:01 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:45:01 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:01 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.427s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:01 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a Nov 02 09:45:01 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:02 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-794d26a1-17c4-4b40-8666-eeb2f305949a" returned: 0 in 0.271s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "cinder-quobyte-794d26a1-17c4-4b40-8666-eeb2f305949a" released by "delete_volume" :: held 0.783s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Created reservations ['f643db65-9349-4743-b412-011320c4d370', '6d52b8d1-659c-4538-8006-fb160b21a812', '88259cd3-c89d-42e3-8579-827e057ef11e', 'a9d9033c-d2e9-4e4d-936b-97f4fe444031'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:02 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:02 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Creating offline snapshot 2035d14e-19c6-4045-92a4-044791c60948 of volume 5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f5a371-32cd-4eb6-8a69-788454c31b78]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:02 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 Nov 02 09:45:02 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Flow 'volume_create_manager' (ecf32a1d-6d31-4c8f-a34e-700c82f3c8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf2ac28-a6cf-4602-a560-b0636c54d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:02 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf2ac28-a6cf-4602-a560-b0636c54d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-623819235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa382f6-d938-4465-8dbe-1db5362fd3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e91bd6938b5451eb344e07fe8657f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:03Z,use_quota=True,user_id='049a36d3ae454dbc8fc0e2fbea7ec937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86d5833-b192-49f7-99fd-b52c6177b1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86d5833-b192-49f7-99fd-b52c6177b1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fad7ce2-9c41-4167-ba92-802c36b183d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fad7ce2-9c41-4167-ba92-802c36b183d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa382f6-d938-4465-8dbe-1db5362fd3b2', 'volume_name': 'volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2', 'volume_size': 2}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff72b6f-7864-463d-bfcf-37e386ba34ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff72b6f-7864-463d-bfcf-37e386ba34ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a894723f-63ae-4b63-abd2-d71c3333b7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Volume cfa382f6-d938-4465-8dbe-1db5362fd3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2', 'volume_size': 2} Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Deleted volume successfully. Nov 02 09:45:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7f11bb8f-1948-4266-afb2-ee97062ac30c tempest-VolumesCloneTest-1920720424 None] Lock "cinder-794d26a1-17c4-4b40-8666-eeb2f305949a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:03 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" returned: 0 in 0.505s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:03 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 1G Nov 02 09:45:03 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:03 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 1G" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:03 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 Nov 02 09:45:03 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:03 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948" returned: 0 in 0.461s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:03 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 is being set with open permissions: ugo+rw Nov 02 09:45:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:03 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 Nov 02 09:45:03 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:04 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:04 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info Nov 02 09:45:04 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:04 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:04 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info is being set with open permissions: ugo+rw Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:04 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info Nov 02 09:45:04 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:04 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.info" returned: 0 in 0.271s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.069s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-623819235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa382f6-d938-4465-8dbe-1db5362fd3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e91bd6938b5451eb344e07fe8657f6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:03Z,use_quota=True,user_id='049a36d3ae454dbc8fc0e2fbea7ec937',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Creating volume cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:04 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 2147483648 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:05 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 2147483648 Nov 02 09:45:05 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-39334572-0dd1-4c3f-9c60-060259b401b9 tempest-SnapshotMetadataTestJSON-894442572 None] Create snapshot completed successfully Nov 02 09:45:05 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 2147483648" returned: 0 in 0.740s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:05 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 Nov 02 09:45:05 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:06 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2" returned: 0 in 0.375s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a894723f-63ae-4b63-abd2-d71c3333b7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2', 'volume_size': 2}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91ded48-8c33-412d-ba35-999cc03f0fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:06 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Volume volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 (cfa382f6-d938-4465-8dbe-1db5362fd3b2): created successfully Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d91ded48-8c33-412d-ba35-999cc03f0fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Flow 'volume_create_manager' (ecf32a1d-6d31-4c8f-a34e-700c82f3c8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d8cc067f-839c-4098-b8dc-1c5555a2f36f tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Created volume successfully. Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "cinder-2035d14e-19c6-4045-92a4-044791c60948-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-2035d14e-19c6-4045-92a4-044791c60948-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "cinder-quobyte-2035d14e-19c6-4045-92a4-044791c60948" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-2035d14e-19c6-4045-92a4-044791c60948" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Deleting offline snapshot 2035d14e-19c6-4045-92a4-044791c60948 of volume 5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] snapshot_file for this snap is: volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[66973f3c-eeaf-4c70-9bf7-8586d5ddfc70]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:07 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 Nov 02 09:45:07 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Creating offline snapshot d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da of volume cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[48069285-170e-4cfe-aa93-06b01b48aa45]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:07 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 Nov 02 09:45:07 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:07 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948" returned: 0 in 0.584s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c56936-b899-4e91-bbde-24a8d0910a35]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Flow 'volume_create_manager' (7f2095bd-b860-4846-94e0-7b0b701eeb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161eac71-7551-4e13-bfa0-08aec611b758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161eac71-7551-4e13-bfa0-08aec611b758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1290110149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880575ec-7cdd-4a4d-b2e5-e61181c5ab02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283c43fc5e0d42efad4ca759253fc1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:08Z,use_quota=True,user_id='922fc76c85644d5a8e7525b7e22cb1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b70daf-60cc-4ddc-a4a9-7ee98d50382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b70daf-60cc-4ddc-a4a9-7ee98d50382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d02b4c6-371a-454a-9ee3-f3469b4963df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d02b4c6-371a-454a-9ee3-f3469b4963df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880575ec-7cdd-4a4d-b2e5-e61181c5ab02', 'volume_name': 'volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02', 'volume_size': 2}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ad45e2-42ca-4adf-9d4f-b95901764dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ad45e2-42ca-4adf-9d4f-b95901764dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2acf99-987e-4b79-869f-880f1238dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Volume 880575ec-7cdd-4a4d-b2e5-e61181c5ab02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02', 'volume_size': 2} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:08 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 Nov 02 09:45:08 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:08 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2" returned: 0 in 0.509s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da 2G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:08 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da 2G Nov 02 09:45:08 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:08 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:08 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 Nov 02 09:45:08 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:08 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da 2G" returned: 0 in 0.527s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:08 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da Nov 02 09:45:08 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:08 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948" returned: 0 in 0.438s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:08 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948 Nov 02 09:45:08 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:09 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" returned: 0 in 0.364s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:09 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da is being set with open permissions: ugo+rw Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:09 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705.2035d14e-19c6-4045-92a4-044791c60948" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:09 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da Nov 02 09:45:09 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-2035d14e-19c6-4045-92a4-044791c60948" released by "_delete_snapshot" :: held 1.954s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" released by "delete_snapshot" :: held 1.987s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Created reservations ['6f11ee73-72bf-45a2-b910-8fc51d5d1572', 'ec0e63d5-3f96-421e-81de-300fd280c87f', '52b32079-cd33-4ad4-a6ab-698d2b724ea9', 'fea196ad-aaa1-4ac1-b700-8d08f7a19b05'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Delete snapshot completed successfully. Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ba923a01-828c-47ec-a184-d4a488551ace tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-2035d14e-19c6-4045-92a4-044791c60948-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:09 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" returned: 0 in 0.292s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:09 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info Nov 02 09:45:09 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:09 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:09 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info is being set with open permissions: ugo+rw Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:09 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info Nov 02 09:45:09 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "cinder-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6aa699-5000-427d-bfbd-3e1ffd0d26aa]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:10 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.info" returned: 0 in 0.331s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:10 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 Nov 02 09:45:10 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1290110149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880575ec-7cdd-4a4d-b2e5-e61181c5ab02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283c43fc5e0d42efad4ca759253fc1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:08Z,use_quota=True,user_id='922fc76c85644d5a8e7525b7e22cb1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Creating volume 880575ec-7cdd-4a4d-b2e5-e61181c5ab02 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:10 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 2147483648 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:10 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 2147483648 Nov 02 09:45:10 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-43aae21a-5b3e-40bc-9ab2-02624442c1d7 tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Create snapshot completed successfully Nov 02 09:45:10 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" returned: 0 in 0.466s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:10 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705 Nov 02 09:45:10 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:10 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 2147483648" returned: 0 in 0.636s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:10 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-quobyte-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705" released by "delete_volume" :: held 0.920s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-22635472-b50c-4acc-b3ef-d414769c7dd8 req-e6dd8a0a-6b54-4618-b76d-18e00526923c tempest-AttachVolumeNegativeTest-730544798 None] Terminate volume connection completed successfully. Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-22635472-b50c-4acc-b3ef-d414769c7dd8 req-e6dd8a0a-6b54-4618-b76d-18e00526923c tempest-AttachVolumeNegativeTest-730544798 None] Deleting attachment 519e15aa-ce44-4cc8-b583-de7ae78cadbc. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:45:10 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 Nov 02 09:45:10 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "cinder-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Created reservations ['bfd77bb3-6f14-46f5-8707-99db5d60d5a3', '7caf0d0c-0116-4d9f-a754-cb0c0336929d', '9949ea29-94ff-45bf-ab1d-af1138a9fe16', '43ee4476-c567-4dc4-be41-b30a751c5e5e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "cinder-quobyte-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Deleting offline snapshot d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da of volume cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] snapshot_file for this snap is: volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e4a69-e32a-4bba-9411-81d1ed909b62]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:11 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" returned: 0 in 0.382s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:11 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:11 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2acf99-987e-4b79-869f-880f1238dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02', 'volume_size': 2}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56398e78-6094-420f-83c2-42addbfb07a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Volume volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 (880575ec-7cdd-4a4d-b2e5-e61181c5ab02): created successfully Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56398e78-6094-420f-83c2-42addbfb07a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Flow 'volume_create_manager' (7f2095bd-b860-4846-94e0-7b0b701eeb82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:11 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da Nov 02 09:45:11 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a42ac660-dde7-4323-9d6e-1e62d4a8d821 tempest-VolumesCloneNegativeTest-1145960188 None] Created volume successfully. Nov 02 09:45:11 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Deleted volume successfully. Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a36cf001-5717-42bb-a624-9d3cb40d437e tempest-SnapshotMetadataTestJSON-894442572 None] Lock "cinder-5c0d4145-1cc2-47c4-bc38-fdd2edd9f705-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:11 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" returned: 0 in 0.478s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e4152-e701-45f6-a59d-146fa4d86724]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:11 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 Nov 02 09:45:11 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:12 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2" returned: 0 in 0.581s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:12 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da Nov 02 09:45:12 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Acquiring lock "cinder-880575ec-7cdd-4a4d-b2e5-e61181c5ab02-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "cinder-880575ec-7cdd-4a4d-b2e5-e61181c5ab02-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Acquiring lock "cinder-quobyte-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "cinder-quobyte-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:12 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f483fa-f866-4c5d-b8c5-c60b24a302a6]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" returned: 0 in 0.746s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:13 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da Nov 02 09:45:13 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:13 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 Nov 02 09:45:13 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:13 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2.d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" returned: 0 in 0.503s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da" released by "_delete_snapshot" :: held 2.505s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" released by "delete_snapshot" :: held 2.549s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:13 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" returned: 0 in 0.711s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:13 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02 Nov 02 09:45:13 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Created reservations ['4dea6aec-5793-41c7-899f-c7f0b49949e9', '9c9abc7d-9c4d-4f06-a6b8-49e26d3ba9c1', '3e4cbcb3-850f-4b4f-8438-a936a302152b', '471d6c69-0c49-4493-adcd-c245e38bac83'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Delete snapshot completed successfully. Nov 02 09:45:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-88d2bfda-c05f-449d-8ac6-1bfab66e160c tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-d4fdbfbd-19fb-4bfd-874c-5e1e3e1bb6da-delete_snapshot" released by "delete_snapshot" :: held 2.859s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:14 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" returned: 0 in 0.345s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "cinder-quobyte-880575ec-7cdd-4a4d-b2e5-e61181c5ab02" released by "delete_volume" :: held 1.133s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Created reservations ['bda23537-851c-48df-a66c-7b69207e74f4', '4624a62d-a1fb-4d87-9c4b-ce934d218474', '37ab164c-491c-4950-90f4-d99c2bf88345', '5f667c5b-7cf4-42aa-82fc-90733e4929c6'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:14 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:14 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "cinder-cfa382f6-d938-4465-8dbe-1db5362fd3b2-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-cfa382f6-d938-4465-8dbe-1db5362fd3b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3239ab9-eb64-46cc-9ba3-15356f392eab]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:14 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:14 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 Nov 02 09:45:14 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Deleted volume successfully. Nov 02 09:45:14 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7e35bae1-8a9a-487e-bdfa-f7d32a17b123 tempest-VolumesCloneNegativeTest-1145960188 None] Lock "cinder-880575ec-7cdd-4a4d-b2e5-e61181c5ab02-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:15 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2" returned: 0 in 0.537s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:15 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2 Nov 02 09:45:15 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:15 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-cfa382f6-d938-4465-8dbe-1db5362fd3b2" returned: 0 in 0.322s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-quobyte-cfa382f6-d938-4465-8dbe-1db5362fd3b2" released by "delete_volume" :: held 0.979s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Created reservations ['2d83cc1a-fbc5-4e05-9c4b-042d83a471a2', '5887041b-83cc-4f16-a2d5-1074c10f4ef8', '2a5b3656-045a-4780-82aa-5562f35a7b18', 'dbb8de0d-8256-4b74-9f99-70d915abf88b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:15 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:15 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:16 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.344s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:16 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Deleted volume successfully. Nov 02 09:45:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-13897d33-81a3-4383-9003-b0a01e8d63bf tempest-VolumesSnapshotNegativeTestJSON-1236957425 None] Lock "cinder-cfa382f6-d938-4465-8dbe-1db5362fd3b2-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Flow 'volume_create_manager' (35130ccd-3994-4ac6-9a11-829debf7d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc47be2-045f-4ae9-b5b1-25e1143f6596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc47be2-045f-4ae9-b5b1-25e1143f6596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1315571996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c423dc83-045d-44d4-a60b-246f71ce81fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8dd12b758f4ee3b9472c79225b1622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:21Z,use_quota=True,user_id='532192dd36ee4adb9d517eb6be04a292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81664c3-b427-4f5a-b5e7-1fe245da2188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81664c3-b427-4f5a-b5e7-1fe245da2188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80635113-0485-466b-9ee7-5739b95798c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Flow 'volume_create_manager' (e1506883-fabe-4ab3-8287-179a69695f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab9798-a727-4b3e-9944-2f2f68842810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab9798-a727-4b3e-9944-2f2f68842810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1195849715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107983ed-6d42-4926-a305-dc9162731228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e374c1e2b9d44a783ad11b330a717d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:22Z,use_quota=True,user_id='d080914ce7764bfe90cff984e8b7b02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbf0687-22cf-4583-bf7c-66c0b08782d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccbf0687-22cf-4583-bf7c-66c0b08782d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6c15e7-6863-4007-b9ef-f6f3811b74e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6c15e7-6863-4007-b9ef-f6f3811b74e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107983ed-6d42-4926-a305-dc9162731228', 'volume_name': 'volume-107983ed-6d42-4926-a305-dc9162731228', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e35764-10b8-4ad6-b82f-a0914276cf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e35764-10b8-4ad6-b82f-a0914276cf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e70b8a-f921-46cb-9540-0132e6930bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Volume 107983ed-6d42-4926-a305-dc9162731228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107983ed-6d42-4926-a305-dc9162731228', 'volume_size': 1} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1195849715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107983ed-6d42-4926-a305-dc9162731228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e374c1e2b9d44a783ad11b330a717d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:22Z,use_quota=True,user_id='d080914ce7764bfe90cff984e8b7b02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Creating volume 107983ed-6d42-4926-a305-dc9162731228 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:22 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:22 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 1073741824 Nov 02 09:45:22 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80635113-0485-466b-9ee7-5739b95798c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c423dc83-045d-44d4-a60b-246f71ce81fe', 'volume_name': 'volume-c423dc83-045d-44d4-a60b-246f71ce81fe', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47179c0e-2d0c-483e-8f87-4145fe7adf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47179c0e-2d0c-483e-8f87-4145fe7adf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767c3015-80aa-4ede-b8a4-efefa4140ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Volume c423dc83-045d-44d4-a60b-246f71ce81fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c423dc83-045d-44d4-a60b-246f71ce81fe', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Trying to clone c423dc83-045d-44d4-a60b-246f71ce81fe from image e2facddb-b106-4022-8544-580b8fc5acbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:45:22 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:45:22 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Image download 20.69 MB at 20.69 MB/s Nov 02 09:45:23 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 1073741824" returned: 0 in 0.871s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[806647e1-012f-4a45-a9c1-cd823b6f00e9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:23 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 Nov 02 09:45:23 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:23 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD Nov 02 09:45:23 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:23 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd is fetched for user 532192dd36ee4adb9d517eb6be04a292. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:45:23 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228" returned: 0 in 0.561s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e70b8a-f921-46cb-9540-0132e6930bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107983ed-6d42-4926-a305-dc9162731228', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26857a85-365d-4e25-83f7-51543839a55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b6ef94-eeaf-4e21-ab93-863077ed14b0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Volume volume-107983ed-6d42-4926-a305-dc9162731228 (107983ed-6d42-4926-a305-dc9162731228): created successfully Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26857a85-365d-4e25-83f7-51543839a55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Flow 'volume_create_manager' (e1506883-fabe-4ab3-8287-179a69695f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f6dd0443-d442-42e0-9617-a4bce1778292 tempest-VolumesTransfersV355Test-1409710604 None] Created volume successfully. Nov 02 09:45:23 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD Nov 02 09:45:23 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:24 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1315571996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c423dc83-045d-44d4-a60b-246f71ce81fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8dd12b758f4ee3b9472c79225b1622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:21Z,use_quota=True,user_id='532192dd36ee4adb9d517eb6be04a292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Creating volume c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:24 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:24 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1073741824 Nov 02 09:45:24 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:24 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1073741824" returned: 0 in 0.616s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:24 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe Nov 02 09:45:24 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3a2fe0e8-88d3-4e3b-8534-461c7f15b930 tempest-VolumesTransfersV355Test-892024374 None] Transfer volume completed successfully. Nov 02 09:45:25 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe" returned: 0 in 0.345s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Attempting download of e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume c423dc83-045d-44d4-a60b-246f71ce81fe. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af42c7a-7e63-4b30-9bf2-374a91eb4b1c]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:25 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz Nov 02 09:45:25 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "cinder-107983ed-6d42-4926-a305-dc9162731228-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-107983ed-6d42-4926-a305-dc9162731228-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "cinder-quobyte-107983ed-6d42-4926-a305-dc9162731228" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-quobyte-107983ed-6d42-4926-a305-dc9162731228" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248ddb6-61f1-41d8-bcc5-235d3ae9a0ca]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:26 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz" returned: 0 in 0.899s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:26 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 Nov 02 09:45:26 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:26 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz Nov 02 09:45:26 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:26 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz" returned: 1 in 0.397s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_bd49umuz' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff1922d-5cc1-4661-a288-0f2b3cbd6b5f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:26 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228" returned: 0 in 0.457s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:26 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228 Nov 02 09:45:26 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:26 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD Nov 02 09:45:26 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:27 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-107983ed-6d42-4926-a305-dc9162731228" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-quobyte-107983ed-6d42-4926-a305-dc9162731228" released by "delete_volume" :: held 0.910s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:27 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD" returned: 0 in 0.661s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] e2facddb-b106-4022-8544-580b8fc5acbd was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:27 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe Nov 02 09:45:27 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Created reservations ['c0f2b5b8-efc0-41e9-92ef-04ca561c149f', 'fd4fbc5a-99b1-4168-a22f-ff66f6d77fcc', '5aa1feaf-f3c5-4a67-be07-1ff5575d72aa', 'b69a089c-4100-4dc6-b9c2-ba34c3dd67ff'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:27 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:27 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:28 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.550s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:28 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Deleted volume successfully. Nov 02 09:45:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53922a77-5692-41e8-a7c5-d76288be7c34 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-107983ed-6d42-4926-a305-dc9162731228-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Flow 'volume_create_manager' (2335849d-a95a-4cf7-99a7-90c161dfde63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f491a0-e1d5-474d-bcac-c00d171dd43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f491a0-e1d5-474d-bcac-c00d171dd43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1390516905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9929b19c-3284-4654-86e6-8c8dee2ffa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e374c1e2b9d44a783ad11b330a717d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:30Z,use_quota=True,user_id='d080914ce7764bfe90cff984e8b7b02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec67a66b-827c-4660-a115-2d4585b186b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec67a66b-827c-4660-a115-2d4585b186b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d71174a-5ff2-4cf1-9680-f8ef3cc08fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d71174a-5ff2-4cf1-9680-f8ef3cc08fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9929b19c-3284-4654-86e6-8c8dee2ffa65', 'volume_name': 'volume-9929b19c-3284-4654-86e6-8c8dee2ffa65', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72caa44-937c-4cc7-90b3-638571739da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72caa44-937c-4cc7-90b3-638571739da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878c012e-141b-484d-aca3-2f3ef5020aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:29 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Volume 9929b19c-3284-4654-86e6-8c8dee2ffa65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9929b19c-3284-4654-86e6-8c8dee2ffa65', 'volume_size': 1} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1390516905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9929b19c-3284-4654-86e6-8c8dee2ffa65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e374c1e2b9d44a783ad11b330a717d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:30Z,use_quota=True,user_id='d080914ce7764bfe90cff984e8b7b02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Creating volume 9929b19c-3284-4654-86e6-8c8dee2ffa65 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:29 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:30 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 1073741824 Nov 02 09:45:30 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:30 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 1073741824" returned: 0 in 0.964s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:31 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 Nov 02 09:45:31 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:31 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe" returned: 0 in 3.733s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_5alj9f6rdevstack@QuobyteHD, size 112.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:45:31 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Converted 112.00 MB image at 29.99 MB/s Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:31 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1G Nov 02 09:45:31 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:31 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65" returned: 0 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878c012e-141b-484d-aca3-2f3ef5020aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9929b19c-3284-4654-86e6-8c8dee2ffa65', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e41253-ffbe-4474-a8fc-8a152005bbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:31 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Volume volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 (9929b19c-3284-4654-86e6-8c8dee2ffa65): created successfully Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e41253-ffbe-4474-a8fc-8a152005bbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Flow 'volume_create_manager' (2335849d-a95a-4cf7-99a7-90c161dfde63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-88f9fc74-278a-4b70-9c92-486be684490d tempest-VolumesTransfersV355Test-1409710604 None] Created volume successfully. Nov 02 09:45:31 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 1G" returned: 0 in 0.671s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Downloaded image e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume c423dc83-045d-44d4-a60b-246f71ce81fe successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd for user 532192dd36ee4adb9d517eb6be04a292 is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Marking volume c423dc83-045d-44d4-a60b-246f71ce81fe as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Copying metadata from image e2facddb-b106-4022-8544-580b8fc5acbd to c423dc83-045d-44d4-a60b-246f71ce81fe. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:45:31 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Creating volume glance metadata for volume c423dc83-045d-44d4-a60b-246f71ce81fe backed by image e2facddb-b106-4022-8544-580b8fc5acbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767c3015-80aa-4ede-b8a4-efefa4140ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c423dc83-045d-44d4-a60b-246f71ce81fe', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82ed1ce-1176-496d-b527-8af1568ae532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:32 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Volume volume-c423dc83-045d-44d4-a60b-246f71ce81fe (c423dc83-045d-44d4-a60b-246f71ce81fe): created successfully Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82ed1ce-1176-496d-b527-8af1568ae532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Flow 'volume_create_manager' (35130ccd-3994-4ac6-9a11-829debf7d347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3d569006-6bba-4a24-b002-297514bba65a tempest-VolumesExtendTest-215617801 None] Created volume successfully. Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "cinder-9929b19c-3284-4654-86e6-8c8dee2ffa65-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-9929b19c-3284-4654-86e6-8c8dee2ffa65-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "cinder-quobyte-9929b19c-3284-4654-86e6-8c8dee2ffa65" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-quobyte-9929b19c-3284-4654-86e6-8c8dee2ffa65" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c78430-966b-4571-8ba4-8157417ad902]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:32 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 Nov 02 09:45:32 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be24b8-6ddf-4a8c-ac72-57f9c906dfe1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:32 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe Nov 02 09:45:32 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:33 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65" returned: 0 in 0.605s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:33 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65 Nov 02 09:45:33 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:33 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe" returned: 0 in 0.592s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 2G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe 2G" returned: 0 in 0.134s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.768s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:33 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9929b19c-3284-4654-86e6-8c8dee2ffa65" returned: 0 in 0.415s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c45f6bf3-aaea-47e7-a746-686d09e86a11 tempest-VolumesExtendTest-215617801 None] Extend volume completed successfully. Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-quobyte-9929b19c-3284-4654-86e6-8c8dee2ffa65" released by "delete_volume" :: held 1.119s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Created reservations ['6ce74851-f4c4-4ee0-bc69-3d7e9fa2d29b', '327b5dde-ad9e-4976-a5b8-ac640f7d9245', '30653031-2e83-4158-a480-deaa3235aac2', '8a2418f0-6a0d-4a32-8cd5-99cf97655f5d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:33 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:33 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:34 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.547s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Deleted volume successfully. Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bbea1648-1604-4e7c-b4f6-bf9c1d76d1b1 tempest-VolumesTransfersV355Test-308249021 None] Lock "cinder-9929b19c-3284-4654-86e6-8c8dee2ffa65-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-c423dc83-045d-44d4-a60b-246f71ce81fe-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "cinder-c423dc83-045d-44d4-a60b-246f71ce81fe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-quobyte-c423dc83-045d-44d4-a60b-246f71ce81fe" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-c423dc83-045d-44d4-a60b-246f71ce81fe" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1cf84-dfc2-43a4-8bd7-4f41979f34a0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:34 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe Nov 02 09:45:34 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:35 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe" returned: 0 in 0.526s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:35 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe Nov 02 09:45:35 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:35 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c423dc83-045d-44d4-a60b-246f71ce81fe" returned: 0 in 0.335s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-c423dc83-045d-44d4-a60b-246f71ce81fe" released by "delete_volume" :: held 0.976s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=147,cinder:SELECT=113,cinder:DELETE=13,cinder:INSERT=42 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Created reservations ['4d00a47d-158d-4cf5-9e12-bfec89f2878c', '97b8408e-d111-41de-b6b4-43efd898304d', '026e097c-0909-448c-bfd8-401e71a15d59', '400424ca-036a-4b1f-9d1e-5232490de367'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=133,cinder:INSERT=58,cinder:UPDATE=144,cinder:DELETE=10 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:35 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:35 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:36 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.347s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:36 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Deleted volume successfully. Nov 02 09:45:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8728a0ac-d204-4a7b-a0b0-78ab0b86589b tempest-VolumesExtendTest-215617801 None] Lock "cinder-c423dc83-045d-44d4-a60b-246f71ce81fe-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Flow 'volume_create_manager' (1408c412-eacc-4545-98e3-42f18a9b7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e343f0c-aac0-49a8-86d5-b14242abf236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e343f0c-aac0-49a8-86d5-b14242abf236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-653221084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da51b5f-abc1-467f-b176-33dfecdbc275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8dd12b758f4ee3b9472c79225b1622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:38Z,use_quota=True,user_id='532192dd36ee4adb9d517eb6be04a292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42580b91-eaba-4fcc-bba3-a5f9604d3b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42580b91-eaba-4fcc-bba3-a5f9604d3b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33a1d2f-aaed-4a09-a393-ead901846d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33a1d2f-aaed-4a09-a393-ead901846d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da51b5f-abc1-467f-b176-33dfecdbc275', 'volume_name': 'volume-8da51b5f-abc1-467f-b176-33dfecdbc275', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d26b71-ea93-4e07-a896-21892a8ffee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d26b71-ea93-4e07-a896-21892a8ffee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739bd312-6d9f-4146-bb39-5e024564f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Volume 8da51b5f-abc1-467f-b176-33dfecdbc275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da51b5f-abc1-467f-b176-33dfecdbc275', 'volume_size': 1} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-653221084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da51b5f-abc1-467f-b176-33dfecdbc275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8dd12b758f4ee3b9472c79225b1622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:38Z,use_quota=True,user_id='532192dd36ee4adb9d517eb6be04a292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Creating volume 8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:37 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:37 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 1073741824 Nov 02 09:45:37 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:38 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 1073741824" returned: 0 in 0.791s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:38 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:38 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:38 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.373s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739bd312-6d9f-4146-bb39-5e024564f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da51b5f-abc1-467f-b176-33dfecdbc275', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e799a-f732-4e58-92aa-492e00029ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Volume volume-8da51b5f-abc1-467f-b176-33dfecdbc275 (8da51b5f-abc1-467f-b176-33dfecdbc275): created successfully Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e799a-f732-4e58-92aa-492e00029ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Flow 'volume_create_manager' (1408c412-eacc-4545-98e3-42f18a9b7b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:39 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f7f3db4c-5ce8-43e8-b42d-71b00bf0a4c0 tempest-VolumesExtendTest-215617801 None] Created volume successfully. Nov 02 09:45:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Creating offline snapshot ac5d464b-8a09-4ca0-b980-893c7dddba67 of volume 8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:45:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecad650-c394-4f48-8273-b905fccd42f4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:40 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:40 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:41 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.594s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:41 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 1G Nov 02 09:45:41 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:41 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 1G" returned: 0 in 0.742s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da51b5f-abc1-467f-b176-33dfecdbc275 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:41 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da51b5f-abc1-467f-b176-33dfecdbc275 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 Nov 02 09:45:41 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:42 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da51b5f-abc1-467f-b176-33dfecdbc275 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67" returned: 0 in 0.541s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:42 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 is being set with open permissions: ugo+rw Nov 02 09:45:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:42 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 Nov 02 09:45:42 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:42 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67" returned: 0 in 0.501s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:42 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info Nov 02 09:45:42 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:43 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info" returned: 0 in 0.267s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:43 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info is being set with open permissions: ugo+rw Nov 02 09:45:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:43 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info Nov 02 09:45:43 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:43 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.info" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4ee52b7b-3323-4aaa-93e2-d41099fe1b0c tempest-VolumesExtendTest-215617801 None] Create snapshot completed successfully Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[397669c7-74b3-4ace-8ea6-d457bbb4d3cd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (3a87c24c-26e7-4bd6-8101-87331aa7d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e14234-9f62-4851-8812-b3c6b51bfd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e14234-9f62-4851-8812-b3c6b51bfd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1133588382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733e3046-1be2-4651-a346-aec14cd0d8b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:45Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ec59bb-e05d-4532-a2a1-0002fabe2b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ec59bb-e05d-4532-a2a1-0002fabe2b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8fbb95-94f2-43b6-b567-2a456b3f7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8fbb95-94f2-43b6-b567-2a456b3f7b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733e3046-1be2-4651-a346-aec14cd0d8b3', 'volume_name': 'volume-733e3046-1be2-4651-a346-aec14cd0d8b3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:45 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:45 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb6bb51-7094-4113-b3a0-e74de308a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb6bb51-7094-4113-b3a0-e74de308a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c279e47c-4689-4c64-9208-3c0183042c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Volume 733e3046-1be2-4651-a346-aec14cd0d8b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733e3046-1be2-4651-a346-aec14cd0d8b3', 'volume_size': 1} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:45 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.461s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 2G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 2G" returned: 0 in 0.187s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.701s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1133588382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733e3046-1be2-4651-a346-aec14cd0d8b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:45Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Creating volume 733e3046-1be2-4651-a346-aec14cd0d8b3 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:45 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 1073741824 Nov 02 09:45:45 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-14efd94c-7888-4074-8a3f-0013e1f9747d tempest-VolumesExtendTest-215617801 None] Extend volume completed successfully. Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-ac5d464b-8a09-4ca0-b980-893c7dddba67-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-ac5d464b-8a09-4ca0-b980-893c7dddba67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-quobyte-ac5d464b-8a09-4ca0-b980-893c7dddba67" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-ac5d464b-8a09-4ca0-b980-893c7dddba67" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Deleting offline snapshot ac5d464b-8a09-4ca0-b980-893c7dddba67 of volume 8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] snapshot_file for this snap is: volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[62530303-843f-4f7c-a46e-41f8a9d7080c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:46 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 1073741824" returned: 0 in 0.553s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:46 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 Nov 02 09:45:46 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:46 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 Nov 02 09:45:46 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:46 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67" returned: 0 in 0.428s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8da51b5f-abc1-467f-b176-33dfecdbc275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:45:46 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[003aebf5-3ddb-49cd-938b-e3b9d1916fe1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3" returned: 0 in 0.373s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c279e47c-4689-4c64-9208-3c0183042c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733e3046-1be2-4651-a346-aec14cd0d8b3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b48d80-4d85-4cf6-8c00-e47232815758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Volume volume-733e3046-1be2-4651-a346-aec14cd0d8b3 (733e3046-1be2-4651-a346-aec14cd0d8b3): created successfully Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b48d80-4d85-4cf6-8c00-e47232815758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (3a87c24c-26e7-4bd6-8101-87331aa7d404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dbb12b20-011b-452b-ba7c-5b2888a655c1 tempest-VolumesListTestJSON-547978719 None] Created volume successfully. Nov 02 09:45:46 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:46 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:47 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.439s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:47 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 Nov 02 09:45:47 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:47 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67" returned: 0 in 0.549s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:47 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67 Nov 02 09:45:47 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (053913bc-b03f-435e-aed7-a746ab1ed96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09586061-5227-4913-ab5b-4115f7004e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09586061-5227-4913-ab5b-4115f7004e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502910521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90953211-603f-4ec3-9e77-556068062fa1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:48Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d6b1e0-67c0-40ab-85e3-18fef9fc21d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d6b1e0-67c0-40ab-85e3-18fef9fc21d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e177f5-ebd5-423a-8f20-369b6a0118ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e177f5-ebd5-423a-8f20-369b6a0118ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90953211-603f-4ec3-9e77-556068062fa1', 'volume_name': 'volume-90953211-603f-4ec3-9e77-556068062fa1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e71ba6-680b-4981-9064-8aa6fe20fb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e71ba6-680b-4981-9064-8aa6fe20fb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e2131-b86c-4cbb-b568-57bff6a1a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Volume 90953211-603f-4ec3-9e77-556068062fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90953211-603f-4ec3-9e77-556068062fa1', 'volume_size': 1} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502910521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90953211-603f-4ec3-9e77-556068062fa1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:48Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Creating volume 90953211-603f-4ec3-9e77-556068062fa1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:47 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:47 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 1073741824 Nov 02 09:45:47 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:47 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275.ac5d464b-8a09-4ca0-b980-893c7dddba67" returned: 0 in 0.305s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-ac5d464b-8a09-4ca0-b980-893c7dddba67" released by "_delete_snapshot" :: held 1.937s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" released by "delete_snapshot" :: held 1.971s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Created reservations ['4f5fa4a5-7596-4a09-8568-832b052022fe', 'aa2a4294-b92f-4666-968d-cbf45fda8d9f', 'be6ed92d-c329-46eb-9cc0-a7a5b3e55e42', '74983aec-4e8d-4a80-8b16-ffa810d5d1d4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Delete snapshot completed successfully. Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-75f61e2c-a40f-42b7-b9a1-a67ba58f6026 tempest-VolumesExtendTest-215617801 None] Lock "cinder-ac5d464b-8a09-4ca0-b980-893c7dddba67-delete_snapshot" released by "delete_snapshot" :: held 2.330s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:48 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 1073741824" returned: 0 in 0.772s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:48 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 Nov 02 09:45:48 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:48 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1" returned: 0 in 0.258s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba3e2131-b86c-4cbb-b568-57bff6a1a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90953211-603f-4ec3-9e77-556068062fa1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e1adb2-0e10-480c-9f69-56f46ce13cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Volume volume-90953211-603f-4ec3-9e77-556068062fa1 (90953211-603f-4ec3-9e77-556068062fa1): created successfully Nov 02 09:45:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e1adb2-0e10-480c-9f69-56f46ce13cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (053913bc-b03f-435e-aed7-a746ab1ed96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-594525d9-6ad1-441f-9876-53096d720bf1 tempest-VolumesListTestJSON-547978719 None] Created volume successfully. Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-8da51b5f-abc1-467f-b176-33dfecdbc275-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "cinder-8da51b5f-abc1-467f-b176-33dfecdbc275-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Acquiring lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" acquired by "delete_volume" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f49fc-1883-4951-88a6-41ef8cc28277]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:49 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:49 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:49 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:50 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275 Nov 02 09:45:50 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:50 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8da51b5f-abc1-467f-b176-33dfecdbc275" returned: 0 in 0.357s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "cinder-quobyte-8da51b5f-abc1-467f-b176-33dfecdbc275" released by "delete_volume" :: held 0.928s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Created reservations ['85a3459d-470e-4c1e-9f31-b589a67ff1ec', 'ed0a9be2-cea7-409f-8e89-43e4d232a62c', '664c53b5-c3a6-4e9f-abb4-83e281bf995a', '767572ca-0878-4b71-b138-02e2fdcadff0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:50 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:50 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (7a92c0bc-a139-493e-b7e7-3d70cd06436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985cb5c1-7dc9-4f76-bcef-97210e8c1688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985cb5c1-7dc9-4f76-bcef-97210e8c1688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-566297897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddccf6f3-cdc2-493e-a4da-f2e7a655fd84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:51Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16242bb2-1001-4625-a879-e7afa45c0ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16242bb2-1001-4625-a879-e7afa45c0ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910f89a1-99e8-4bdf-8ca0-f56866a43ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910f89a1-99e8-4bdf-8ca0-f56866a43ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddccf6f3-cdc2-493e-a4da-f2e7a655fd84', 'volume_name': 'volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e82930-95f3-4c35-84bb-728e8c84e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e82930-95f3-4c35-84bb-728e8c84e28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:50 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebadf09-35bd-4885-bb1f-9eeac62af979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Volume ddccf6f3-cdc2-493e-a4da-f2e7a655fd84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84', 'volume_size': 1} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-566297897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddccf6f3-cdc2-493e-a4da-f2e7a655fd84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='837a9890b9b74a019e6c897f2e8a1770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:51Z,use_quota=True,user_id='9c8ff8de06f849609655ebed42e77aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Creating volume ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:50 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:50 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Deleted volume successfully. Nov 02 09:45:50 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 1073741824 Nov 02 09:45:50 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8474a0bb-c28f-4e84-ad2e-daa1f6aa5928 tempest-VolumesExtendTest-215617801 None] Lock "cinder-8da51b5f-abc1-467f-b176-33dfecdbc275-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:51 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 1073741824" returned: 0 in 0.917s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:51 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 Nov 02 09:45:51 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:52 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" returned: 0 in 0.556s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebadf09-35bd-4885-bb1f-9eeac62af979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5f886-f088-4657-8e2e-cd891d34a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:52 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Volume volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 (ddccf6f3-cdc2-493e-a4da-f2e7a655fd84): created successfully Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d5f886-f088-4657-8e2e-cd891d34a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Flow 'volume_create_manager' (7a92c0bc-a139-493e-b7e7-3d70cd06436c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d53bb6af-2380-4e11-ae44-da63e17178a6 tempest-VolumesListTestJSON-547978719 None] Created volume successfully. Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (59dd86e6-84d6-4cc8-ac9a-677529e08272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50525e6-1df8-4a2a-8760-bd106a83bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50525e6-1df8-4a2a-8760-bd106a83bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-896379697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62c500a-0858-4a47-9aa7-779805ae1c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:54Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412f8ca-435e-44c6-8a17-a92fbd2e727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412f8ca-435e-44c6-8a17-a92fbd2e727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa100b93-5b91-474b-86e4-15a56b639b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa100b93-5b91-474b-86e4-15a56b639b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd62c500a-0858-4a47-9aa7-779805ae1c67', 'volume_name': 'volume-d62c500a-0858-4a47-9aa7-779805ae1c67', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bac850-366b-4029-9a80-2a155dcffd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20bac850-366b-4029-9a80-2a155dcffd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47498d5c-8ee0-4699-9983-e8771fef8678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Volume d62c500a-0858-4a47-9aa7-779805ae1c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d62c500a-0858-4a47-9aa7-779805ae1c67', 'volume_size': 1} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-896379697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d62c500a-0858-4a47-9aa7-779805ae1c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:54Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Creating volume d62c500a-0858-4a47-9aa7-779805ae1c67 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:54 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:54 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 1073741824 Nov 02 09:45:54 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:55 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 1073741824" returned: 0 in 0.876s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:55 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 Nov 02 09:45:55 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:55 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47498d5c-8ee0-4699-9983-e8771fef8678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d62c500a-0858-4a47-9aa7-779805ae1c67', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6595e4-2b26-43cc-abdb-71745f95446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Volume volume-d62c500a-0858-4a47-9aa7-779805ae1c67 (d62c500a-0858-4a47-9aa7-779805ae1c67): created successfully Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6595e4-2b26-43cc-abdb-71745f95446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (59dd86e6-84d6-4cc8-ac9a-677529e08272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3aa7028b-7d9a-414c-b60c-3749e5f54565 tempest-AttachVolumeNegativeTest-730544798 None] Created volume successfully. Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "cinder-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Flow 'volume_create_manager' (6ec18feb-18a7-4495-b539-30a080be3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6df1fb2-99f0-41b0-afd2-01b64373b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-quobyte-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6df1fb2-99f0-41b0-afd2-01b64373b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1735775315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58374c-8181-4293-a234-cb6c499a3514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d1cf414498458f86560e21e1f5957f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:56Z,use_quota=True,user_id='5a561a7ceebd44a2a3db1e6e85aaa764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d4dfb1-aeb0-47f2-9eca-eeed722126db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4d4dfb1-aeb0-47f2-9eca-eeed722126db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc82f0-523d-4d05-bdf9-707bddad009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cfc82f0-523d-4d05-bdf9-707bddad009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc58374c-8181-4293-a234-cb6c499a3514', 'volume_name': 'volume-dc58374c-8181-4293-a234-cb6c499a3514', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6f0a99-4cec-4013-b6a7-3bb3f25a78bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6f0a99-4cec-4013-b6a7-3bb3f25a78bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc3d16-5b88-4920-9d56-03ae6f3f4852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Volume dc58374c-8181-4293-a234-cb6c499a3514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc58374c-8181-4293-a234-cb6c499a3514', 'volume_size': 1} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1735775315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc58374c-8181-4293-a234-cb6c499a3514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d1cf414498458f86560e21e1f5957f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:45:56Z,use_quota=True,user_id='5a561a7ceebd44a2a3db1e6e85aaa764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Creating volume dc58374c-8181-4293-a234-cb6c499a3514 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:45:56 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" acquired by "delete_volume" :: waited 0.130s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:56 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 1073741824 Nov 02 09:45:56 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f0118a-9514-4cf2-80a1-380cd1034750]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:56 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 Nov 02 09:45:56 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:57 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" returned: 0 in 0.566s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:57 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84 Nov 02 09:45:57 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:57 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 1073741824" returned: 0 in 0.802s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:57 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 Nov 02 09:45:57 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e9dd4728-f5fa-4372-a0ce-384caf433840 req-78703867-c631-4652-9a49-1fa2a9139997 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:57 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" returned: 0 in 0.372s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84" released by "delete_volume" :: held 1.012s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Created reservations ['34a6ef93-1acf-4840-97b7-d6cd64dfb4db', '68366e33-6f33-4dd0-90d8-c785e1fe2158', 'e05394f1-064f-4327-9f64-f199b005ebcb', '0198c93b-a9da-4541-9874-5b7ac971e0a2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:57 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e9dd4728-f5fa-4372-a0ce-384caf433840 req-78703867-c631-4652-9a49-1fa2a9139997 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.215s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:57 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e9dd4728-f5fa-4372-a0ce-384caf433840 req-78703867-c631-4652-9a49-1fa2a9139997 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:57 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc3d16-5b88-4920-9d56-03ae6f3f4852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc58374c-8181-4293-a234-cb6c499a3514', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf233c7-1975-4f8b-946c-4da77b961a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:45:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Volume volume-dc58374c-8181-4293-a234-cb6c499a3514 (dc58374c-8181-4293-a234-cb6c499a3514): created successfully Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bf233c7-1975-4f8b-946c-4da77b961a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Flow 'volume_create_manager' (6ec18feb-18a7-4495-b539-30a080be3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:45:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-e9dd4728-f5fa-4372-a0ce-384caf433840 req-78703867-c631-4652-9a49-1fa2a9139997 tempest-AttachVolumeNegativeTest-730544798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-d62c500a-0858-4a47-9aa7-779805ae1c67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daa1415b-1134-4ad5-bd45-71b2b265fd59', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:45:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8b774f11-8bfe-4148-a1a6-eada2ab3f8f6 tempest-VolumesNegativeTest-305976597 None] Created volume successfully. Nov 02 09:45:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-e9dd4728-f5fa-4372-a0ce-384caf433840 req-78703867-c631-4652-9a49-1fa2a9139997 tempest-AttachVolumeNegativeTest-730544798 None] attachment_update completed successfully. Nov 02 09:45:58 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Deleted volume successfully. Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dce33612-750e-4359-824a-9a243e17eefb tempest-VolumesListTestJSON-547978719 None] Lock "cinder-ddccf6f3-cdc2-493e-a4da-f2e7a655fd84-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:58 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:45:58 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:58 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-90953211-603f-4ec3-9e77-556068062fa1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "cinder-90953211-603f-4ec3-9e77-556068062fa1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-quobyte-90953211-603f-4ec3-9e77-556068062fa1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-90953211-603f-4ec3-9e77-556068062fa1" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422ee6c-cb84-4fb0-a3f3-25aba8e0f8ab]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:45:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:59 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 Nov 02 09:45:59 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:59 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1" returned: 0 in 0.517s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:45:59 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1 Nov 02 09:45:59 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:45:59 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Nov 02 09:45:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90953211-603f-4ec3-9e77-556068062fa1" returned: 0 in 0.345s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:45:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-90953211-603f-4ec3-9e77-556068062fa1" released by "delete_volume" :: held 0.925s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:45:59 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Created reservations ['45682ec2-d7b5-4132-b98b-3c6f1717d513', '59d82d48-4f94-4876-abd0-3b1c8a37381c', '3f42db2b-2a01-4e0c-a937-4ad0ed32de66', '843d6e1b-ff83-4c37-aecc-ce980c8f37a1'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:00 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:46:00 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:00 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:46:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Deleted volume successfully. Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6792380d-1d64-422b-acc9-cc85d3193306 tempest-VolumesListTestJSON-547978719 None] Lock "cinder-90953211-603f-4ec3-9e77-556068062fa1-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:46:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-4054151b-3af5-440c-be22-029f81319c06 req-6924b6bc-c602-4a22-8fd7-74d58aafc18a tempest-AttachVolumeNegativeTest-730544798 None] Terminate volume connection completed successfully. Nov 02 09:46:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-4054151b-3af5-440c-be22-029f81319c06 req-6924b6bc-c602-4a22-8fd7-74d58aafc18a tempest-AttachVolumeNegativeTest-730544798 None] Deleting attachment daa1415b-1134-4ad5-bd45-71b2b265fd59. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-733e3046-1be2-4651-a346-aec14cd0d8b3-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "cinder-733e3046-1be2-4651-a346-aec14cd0d8b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Acquiring lock "cinder-quobyte-733e3046-1be2-4651-a346-aec14cd0d8b3" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-733e3046-1be2-4651-a346-aec14cd0d8b3" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[09327cbb-31bb-4795-9d82-4cdfd6bdd78d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:46:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:01 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 Nov 02 09:46:01 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:02 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3" returned: 0 in 0.706s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:02 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3 Nov 02 09:46:02 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:02 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-733e3046-1be2-4651-a346-aec14cd0d8b3" returned: 0 in 0.630s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "cinder-quobyte-733e3046-1be2-4651-a346-aec14cd0d8b3" released by "delete_volume" :: held 1.424s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:46:02 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Created reservations ['a5de7b99-2288-4ba9-b200-88d6ca0c81c3', '9c701315-17d1-4bee-afa8-e5c41ca4ac43', 'da800b41-8f4d-4ad1-a3cc-0bc309524f00', '9548337e-dab0-45c0-9f1e-0720899b3446'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:03 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:46:03 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:03 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.350s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:46:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Deleted volume successfully. Nov 02 09:46:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4bfcd6c1-9d70-4353-9c7a-1d53b1b05eca tempest-VolumesListTestJSON-547978719 None] Lock "cinder-733e3046-1be2-4651-a346-aec14cd0d8b3-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:46:12 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=50,cinder:UPDATE=75,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:46:13 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=61,cinder:SELECT=53,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Flow 'volume_create_manager' (a998d555-6de1-4723-af21-169a5a7596dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5638a47e-76c7-425e-a676-96c56a1695f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5638a47e-76c7-425e-a676-96c56a1695f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1853411462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b68a8d-c22e-491c-93d0-6a8ef3f700ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a7bfd1325c453fb8e17f2d8a84150b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:31Z,use_quota=True,user_id='07241a07fa8f42f0ac81e990eb1e5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd009107-8831-4f31-9964-7285c7007f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd009107-8831-4f31-9964-7285c7007f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe2df70-293f-4e55-bf2a-3f6773a33167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe2df70-293f-4e55-bf2a-3f6773a33167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b68a8d-c22e-491c-93d0-6a8ef3f700ee', 'volume_name': 'volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b25dfbc-aab7-4cf1-937d-8a260b223009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b25dfbc-aab7-4cf1-937d-8a260b223009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4362eb82-008c-49b4-bc0e-904628f53cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:31 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Volume 66b68a8d-c22e-491c-93d0-6a8ef3f700ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee', 'volume_size': 1} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1853411462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b68a8d-c22e-491c-93d0-6a8ef3f700ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92a7bfd1325c453fb8e17f2d8a84150b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:31Z,use_quota=True,user_id='07241a07fa8f42f0ac81e990eb1e5604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Creating volume 66b68a8d-c22e-491c-93d0-6a8ef3f700ee {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:46:31 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:46:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:31 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee 1073741824 Nov 02 09:46:31 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:32 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee 1073741824" returned: 0 in 1.257s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:32 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee Nov 02 09:46:32 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:32 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4362eb82-008c-49b4-bc0e-904628f53cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d31800-8c91-46bd-937a-e5ab5f247fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:32 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Volume volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee (66b68a8d-c22e-491c-93d0-6a8ef3f700ee): created successfully Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d31800-8c91-46bd-937a-e5ab5f247fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Flow 'volume_create_manager' (a998d555-6de1-4723-af21-169a5a7596dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:46:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-16622391-be3e-41cb-a7ce-d8f66aeac3f5 tempest-TestMinimumBasicScenario-1444018544 None] Created volume successfully. Nov 02 09:46:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Acquiring lock "cinder-dc58374c-8181-4293-a234-cb6c499a3514-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:46:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "cinder-dc58374c-8181-4293-a234-cb6c499a3514-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:46:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Acquiring lock "cinder-quobyte-dc58374c-8181-4293-a234-cb6c499a3514" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:46:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "cinder-quobyte-dc58374c-8181-4293-a234-cb6c499a3514" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:46:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58a685f-f4d8-4df3-9bfb-5ca35ff75e8e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:46:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:35 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 Nov 02 09:46:35 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:35 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514" returned: 0 in 0.743s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:35 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514 Nov 02 09:46:35 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e6d37daf-fdb5-45f9-b866-eef163a2eb02 req-710e931e-b64c-48f6-91e5-d12a96cafb89 tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e6d37daf-fdb5-45f9-b866-eef163a2eb02 req-710e931e-b64c-48f6-91e5-d12a96cafb89 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-e6d37daf-fdb5-45f9-b866-eef163a2eb02 req-710e931e-b64c-48f6-91e5-d12a96cafb89 tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-e6d37daf-fdb5-45f9-b866-eef163a2eb02 req-710e931e-b64c-48f6-91e5-d12a96cafb89 tempest-TestMinimumBasicScenario-1444018544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eef0902-fd06-41e1-925f-3eaec2da23f6', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:46:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-e6d37daf-fdb5-45f9-b866-eef163a2eb02 req-710e931e-b64c-48f6-91e5-d12a96cafb89 tempest-TestMinimumBasicScenario-1444018544 None] attachment_update completed successfully. Nov 02 09:46:36 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dc58374c-8181-4293-a234-cb6c499a3514" returned: 0 in 0.518s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "cinder-quobyte-dc58374c-8181-4293-a234-cb6c499a3514" released by "delete_volume" :: held 1.401s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Created reservations ['0310a0ac-095d-4c54-8520-618df04e7d78', '2edfb1ac-7b88-48cc-8433-9a9e703d6c55', '0beabbd3-1573-4b28-b9bb-b3e9f52d7ad1', '2e319b09-193b-41c2-82b7-3a831a64378b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:36 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:46:36 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:37 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.466s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:37 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:46:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Deleted volume successfully. Nov 02 09:46:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d3785290-d0dc-495c-9289-39d64e1232b7 tempest-VolumesNegativeTest-305976597 None] Lock "cinder-dc58374c-8181-4293-a234-cb6c499a3514-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:46:55 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:46:55 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=14 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:46:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Flow 'volume_create_manager' (6db1d079-58b2-435a-8e9a-6bddd0e3ad97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0818cef6-7c4d-48ca-ab91-310e6c35628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0818cef6-7c4d-48ca-ab91-310e6c35628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1337121319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceff4ed-0296-4f56-98e5-0e57720821b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b716352725f5451a9611a96b27fdb79f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:57Z,use_quota=True,user_id='1fc3b9a9a24740a196cb257f846f13bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00cb5f-82ba-4e7f-a5c1-6b33295223d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b00cb5f-82ba-4e7f-a5c1-6b33295223d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0f91f0-3f95-4c0a-ada9-87c9b829acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0f91f0-3f95-4c0a-ada9-87c9b829acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ceff4ed-0296-4f56-98e5-0e57720821b5', 'volume_name': 'volume-9ceff4ed-0296-4f56-98e5-0e57720821b5', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fb0b6a-cb76-4040-ab7f-717af2dabc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53fb0b6a-cb76-4040-ab7f-717af2dabc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237c1259-448e-46ae-b032-86721edd7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Volume 9ceff4ed-0296-4f56-98e5-0e57720821b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ceff4ed-0296-4f56-98e5-0e57720821b5', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Trying to clone 9ceff4ed-0296-4f56-98e5-0e57720821b5 from image e2facddb-b106-4022-8544-580b8fc5acbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:46:57 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:46:57 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Image download 20.69 MB at 20.69 MB/s Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94c8f5-e03a-48e3-8d8a-f18f76d5c814]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:58 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD Nov 02 09:46:58 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:58 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:46:58 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:58 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.405s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:46:58 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD" returned: 0 in 0.603s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd is fetched for user 1fc3b9a9a24740a196cb257f846f13bc. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c69a7b-92e7-4741-a498-564cc8318e65]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:46:58 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD Nov 02 09:46:58 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (3bcc8dce-6483-44f6-9f0d-aa9dfa633d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d8c94-2c66-470d-a9c8-11cdc2d05c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d8c94-2c66-470d-a9c8-11cdc2d05c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-145019206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97c0afb-f9c1-4a83-bd25-9e75abb2a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:59Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62a3ef9-ddd6-4610-9a94-7ca068585869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62a3ef9-ddd6-4610-9a94-7ca068585869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f118aa55-cd3b-4a27-bbd8-dc85830a3cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f118aa55-cd3b-4a27-bbd8-dc85830a3cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97c0afb-f9c1-4a83-bd25-9e75abb2a844', 'volume_name': 'volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e45fb4a-63f1-413c-a71c-b53571404237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e45fb4a-63f1-413c-a71c-b53571404237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb73ac2-7d86-4eec-8888-a077da6096c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:46:59 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Volume e97c0afb-f9c1-4a83-bd25-9e75abb2a844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844', 'volume_size': 1} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-145019206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97c0afb-f9c1-4a83-bd25-9e75abb2a844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cacd8ea872147eeaba7baa10393b43c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:59Z,use_quota=True,user_id='025f060bcc474e39b820569622a20258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Creating volume e97c0afb-f9c1-4a83-bd25-9e75abb2a844 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:46:59 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:59 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 1073741824 Nov 02 09:46:59 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:46:59 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:46:59 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 1073741824" returned: 0 in 0.647s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:46:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:46:59 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 Nov 02 09:46:59 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:00 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" returned: 0 in 0.265s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1337121319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ceff4ed-0296-4f56-98e5-0e57720821b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b716352725f5451a9611a96b27fdb79f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:46:57Z,use_quota=True,user_id='1fc3b9a9a24740a196cb257f846f13bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Creating volume 9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:00 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb73ac2-7d86-4eec-8888-a077da6096c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:00 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1073741824 Nov 02 09:47:00 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1852698b-fa3d-4c68-a143-8d734a2251a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:00 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Volume volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 (e97c0afb-f9c1-4a83-bd25-9e75abb2a844): created successfully Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1852698b-fa3d-4c68-a143-8d734a2251a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Flow 'volume_create_manager' (3bcc8dce-6483-44f6-9f0d-aa9dfa633d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7793c0d0-a462-4711-8cac-becc007e10b7 tempest-AttachVolumeNegativeTest-730544798 None] Created volume successfully. Nov 02 09:47:00 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1073741824" returned: 0 in 0.564s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:00 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 Nov 02 09:47:00 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:01 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5" returned: 0 in 0.520s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Attempting download of e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 9ceff4ed-0296-4f56-98e5-0e57720821b5. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5a82cc-75e6-493d-8460-08c0eaef2809]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:01 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v Nov 02 09:47:01 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:01 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v" returned: 0 in 0.537s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:02 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v Nov 02 09:47:02 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ae95fc4c-b0ce-4e0b-ae9e-5fcd758119fd req-ca6d06ea-83f1-42f5-841b-6edca5d2c8ae tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ae95fc4c-b0ce-4e0b-ae9e-5fcd758119fd req-ca6d06ea-83f1-42f5-841b-6edca5d2c8ae tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-ae95fc4c-b0ce-4e0b-ae9e-5fcd758119fd req-ca6d06ea-83f1-42f5-841b-6edca5d2c8ae tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-ae95fc4c-b0ce-4e0b-ae9e-5fcd758119fd req-ca6d06ea-83f1-42f5-841b-6edca5d2c8ae tempest-AttachVolumeNegativeTest-730544798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8eb6b42c-490a-498c-97e1-dfb0b0cc9e74', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:47:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-ae95fc4c-b0ce-4e0b-ae9e-5fcd758119fd req-ca6d06ea-83f1-42f5-841b-6edca5d2c8ae tempest-AttachVolumeNegativeTest-730544798 None] attachment_update completed successfully. Nov 02 09:47:02 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v" returned: 1 in 0.450s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2facddb-b106-4022-8544-580b8fc5acbd_2u0xz90v' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49aa324-0dff-41df-a6d1-006cb7eaa652]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:02 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD Nov 02 09:47:02 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:02 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] e2facddb-b106-4022-8544-580b8fc5acbd was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:47:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:02 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 Nov 02 09:47:02 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-2301c0a6-f6bd-44e6-b7a7-48a0ac4489d6 req-15ecd4b8-02a4-4741-92e4-2db70fd72217 tempest-AttachVolumeNegativeTest-730544798 None] Terminate volume connection completed successfully. Nov 02 09:47:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-2301c0a6-f6bd-44e6-b7a7-48a0ac4489d6 req-15ecd4b8-02a4-4741-92e4-2db70fd72217 tempest-AttachVolumeNegativeTest-730544798 None] Deleting attachment 8eb6b42c-490a-498c-97e1-dfb0b0cc9e74. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:47:05 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5" returned: 0 in 2.541s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2facddb-b106-4022-8544-580b8fc5acbd_po7r_oaedevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:47:05 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Converted 112.00 MB image at 44.06 MB/s Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:05 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1G Nov 02 09:47:05 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:05 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 1G" returned: 0 in 0.482s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Downloaded image e2facddb-b106-4022-8544-580b8fc5acbd ((None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}])) to volume 9ceff4ed-0296-4f56-98e5-0e57720821b5 successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Temporary image e2facddb-b106-4022-8544-580b8fc5acbd for user 1fc3b9a9a24740a196cb257f846f13bc is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Marking volume 9ceff4ed-0296-4f56-98e5-0e57720821b5 as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Copying metadata from image e2facddb-b106-4022-8544-580b8fc5acbd to 9ceff4ed-0296-4f56-98e5-0e57720821b5. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:47:05 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Creating volume glance metadata for volume 9ceff4ed-0296-4f56-98e5-0e57720821b5 backed by image e2facddb-b106-4022-8544-580b8fc5acbd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:47:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237c1259-448e-46ae-b032-86721edd7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ceff4ed-0296-4f56-98e5-0e57720821b5', 'volume_size': 1, 'image_id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2facddb-b106-4022-8544-580b8fc5acbd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbeac93034204a5387981fe7664910e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2facddb-b106-4022-8544-580b8fc5acbd', 'created_at': datetime.datetime(2026, 11, 2, 8, 30, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 30, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2facddb-b106-4022-8544-580b8fc5acbd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd9aca-f511-446b-8b4e-785173fa5e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:06 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Volume volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 (9ceff4ed-0296-4f56-98e5-0e57720821b5): created successfully Nov 02 09:47:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bd9aca-f511-446b-8b4e-785173fa5e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Flow 'volume_create_manager' (6db1d079-58b2-435a-8e9a-6bddd0e3ad97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1c9cb595-5f79-4c1a-aa38-ffcb2d5e93ae tempest-TestShelveInstance-1798832710 None] Created volume successfully. Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-e97c0afb-f9c1-4a83-bd25-9e75abb2a844-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-e97c0afb-f9c1-4a83-bd25-9e75abb2a844-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-quobyte-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[43213ac5-ba08-425e-a26f-384e1fc9b995]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:13 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 Nov 02 09:47:13 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-f76c9fb0-2d8c-4ce4-9685-649ebd920328 req-8ae31179-3591-488a-9b39-ca65a5baa238 tempest-TestShelveInstance-1798832710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-f76c9fb0-2d8c-4ce4-9685-649ebd920328 req-8ae31179-3591-488a-9b39-ca65a5baa238 tempest-TestShelveInstance-1798832710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-f76c9fb0-2d8c-4ce4-9685-649ebd920328 req-8ae31179-3591-488a-9b39-ca65a5baa238 tempest-TestShelveInstance-1798832710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-f76c9fb0-2d8c-4ce4-9685-649ebd920328 req-8ae31179-3591-488a-9b39-ca65a5baa238 tempest-TestShelveInstance-1798832710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-9ceff4ed-0296-4f56-98e5-0e57720821b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6495ca21-038d-4a24-a396-235c8cddefb1', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:47:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-f76c9fb0-2d8c-4ce4-9685-649ebd920328 req-8ae31179-3591-488a-9b39-ca65a5baa238 tempest-TestShelveInstance-1798832710 None] attachment_update completed successfully. Nov 02 09:47:13 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" returned: 0 in 0.906s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:13 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844 Nov 02 09:47:13 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:14 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" returned: 0 in 0.433s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-e97c0afb-f9c1-4a83-bd25-9e75abb2a844" released by "delete_volume" :: held 1.501s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Created reservations ['391ce226-be6b-48de-b202-b45cd75fa5d3', 'efed8384-9581-4fa1-9cbc-ecf6e46d3165', '9e1d9d45-e37f-49f1-8c88-621880cd5a66', '9a06f405-e999-4c3a-ab2f-757448b2523e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:14 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:47:14 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:15 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:47:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Deleted volume successfully. Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-976fba28-ac92-44ed-9347-48f26fbc5c58 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-e97c0afb-f9c1-4a83-bd25-9e75abb2a844-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-d62c500a-0858-4a47-9aa7-779805ae1c67-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-d62c500a-0858-4a47-9aa7-779805ae1c67-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-quobyte-d62c500a-0858-4a47-9aa7-779805ae1c67" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-d62c500a-0858-4a47-9aa7-779805ae1c67" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db647e-df1e-4b9a-90a4-e5925da9a6b3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:15 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 Nov 02 09:47:15 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:15 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67" returned: 0 in 0.514s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:16 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67 Nov 02 09:47:16 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (c1d7fc7c-e867-4a6d-9445-c1071b69aaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4258e1b3-f159-42ff-840a-b9688ad8005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4258e1b3-f159-42ff-840a-b9688ad8005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1518730289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a776068-72d4-403c-8a6c-dbaf1b815578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:16Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e19bc6f-c396-4e7c-ac68-ac2816f7b127),volume_type_id=1e19bc6f-c396-4e7c-ac68-ac2816f7b127)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ae33f1-c407-4d7a-bd4b-3a93322a8b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ae33f1-c407-4d7a-bd4b-3a93322a8b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f9f5b0-6ae2-4dcc-9802-0582945f9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f9f5b0-6ae2-4dcc-9802-0582945f9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a776068-72d4-403c-8a6c-dbaf1b815578', 'volume_name': 'volume-0a776068-72d4-403c-8a6c-dbaf1b815578', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:16 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8ca159-abc1-4d1b-aaff-0e8d9c7855db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8ca159-abc1-4d1b-aaff-0e8d9c7855db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecef8e52-46bd-414c-946a-8dac8c5e57a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:16 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume 0a776068-72d4-403c-8a6c-dbaf1b815578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a776068-72d4-403c-8a6c-dbaf1b815578', 'volume_size': 1} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1518730289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a776068-72d4-403c-8a6c-dbaf1b815578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:16Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e19bc6f-c396-4e7c-ac68-ac2816f7b127),volume_type_id=1e19bc6f-c396-4e7c-ac68-ac2816f7b127)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Creating volume 0a776068-72d4-403c-8a6c-dbaf1b815578 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:16 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d62c500a-0858-4a47-9aa7-779805ae1c67" returned: 0 in 0.737s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:16 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 1073741824 Nov 02 09:47:16 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-d62c500a-0858-4a47-9aa7-779805ae1c67" released by "delete_volume" :: held 1.362s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:16 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Created reservations ['cccc5412-c1cd-4d72-b702-5d2f0566c8a7', '71490fe8-71cf-45aa-9f9e-9dfccc926d3f', '8baa304c-2d67-47d8-918f-0d99b5973921', '1e667a5c-1b1d-41bb-b8d5-ef49d12733c5'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:17 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:47:17 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (fcaf32bb-1e01-4d59-a8c4-d718c51764d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc0fd3a-a485-400f-a1a3-0d747c749514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc0fd3a-a485-400f-a1a3-0d747c749514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-322731860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a641eaef-3ef8-42b7-8f05-c3d4449433fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:17Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe9e23f-c202-4bad-b733-f4260ba9a5f2),volume_type_id=dbe9e23f-c202-4bad-b733-f4260ba9a5f2)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887fe359-e32d-4d33-91f4-7d1a50098d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887fe359-e32d-4d33-91f4-7d1a50098d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77127370-04f7-4d92-90da-6f50c72ee387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77127370-04f7-4d92-90da-6f50c72ee387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a641eaef-3ef8-42b7-8f05-c3d4449433fd', 'volume_name': 'volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b043762a-eb34-4b38-95bc-495a30075200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b043762a-eb34-4b38-95bc-495a30075200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24712e00-f01e-495a-bdff-96d018ebffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume a641eaef-3ef8-42b7-8f05-c3d4449433fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd', 'volume_size': 1} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:17 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 1073741824" returned: 0 in 0.948s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:17 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.711s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:17 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:47:17 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 Nov 02 09:47:17 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Deleted volume successfully. Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-580fc7f6-e6bb-48ab-9207-48fe9f032bb0 tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-d62c500a-0858-4a47-9aa7-779805ae1c67-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-f7241cc2-6bd6-4288-b79a-6a514e485c20-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-f7241cc2-6bd6-4288-b79a-6a514e485c20-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:18 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578" returned: 0 in 1.079s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-322731860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a641eaef-3ef8-42b7-8f05-c3d4449433fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:17Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbe9e23f-c202-4bad-b733-f4260ba9a5f2),volume_type_id=dbe9e23f-c202-4bad-b733-f4260ba9a5f2)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Creating volume a641eaef-3ef8-42b7-8f05-c3d4449433fd {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:18 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:47:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:19 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd 1073741824 Nov 02 09:47:19 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "cinder-quobyte-f7241cc2-6bd6-4288-b79a-6a514e485c20" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecef8e52-46bd-414c-946a-8dac8c5e57a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a776068-72d4-403c-8a6c-dbaf1b815578', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fee3799-66ed-4085-b16b-5563c6860f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-f7241cc2-6bd6-4288-b79a-6a514e485c20" acquired by "delete_volume" :: waited 0.140s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume volume-0a776068-72d4-403c-8a6c-dbaf1b815578 (0a776068-72d4-403c-8a6c-dbaf1b815578): created successfully Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fee3799-66ed-4085-b16b-5563c6860f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (c1d7fc7c-e867-4a6d-9445-c1071b69aaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b507b0b5-a898-4234-86b5-ead031b18ac1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (8d9f3abf-d770-45fd-9440-2574f1054f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0169566-c092-4833-9b95-94fe30d152f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0169566-c092-4833-9b95-94fe30d152f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1510284338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba804f6-97e8-4152-9a59-c11b9c7668b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:19Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f928d74b-9e3a-48c4-bd38-4618f1c106e6),volume_type_id=f928d74b-9e3a-48c4-bd38-4618f1c106e6)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2066bae6-8d00-4f65-9b39-f2d41c158bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2066bae6-8d00-4f65-9b39-f2d41c158bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77cedea-68e0-4367-8fa0-d019afe6fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:19 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:47:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ade3144d-4502-44e8-8af7-2c348caf4b52 tempest-TestInstancesWithCinderVolumes-1055599225 None] Created volume successfully. Nov 02 09:47:19 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 Nov 02 09:47:19 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:20 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd 1073741824" returned: 0 in 1.519s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:20 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20" returned: 0 in 1.206s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:20 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20 Nov 02 09:47:20 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:20 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd Nov 02 09:47:20 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77cedea-68e0-4367-8fa0-d019afe6fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bba804f6-97e8-4152-9a59-c11b9c7668b0', 'volume_name': 'volume-bba804f6-97e8-4152-9a59-c11b9c7668b0', 'volume_size': 1, 'image_id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--602895320', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '08f7c3f85aae4877b9e09e8aac8ebabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'created_at': datetime.datetime(2026, 11, 2, 8, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa9149e-c654-4f20-af1c-bf944c16cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa9149e-c654-4f20-af1c-bf944c16cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b216eb24-5315-477e-8c4d-1a752d6cc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume bba804f6-97e8-4152-9a59-c11b9c7668b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bba804f6-97e8-4152-9a59-c11b9c7668b0', 'volume_size': 1, 'image_id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--602895320', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '08f7c3f85aae4877b9e09e8aac8ebabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'created_at': datetime.datetime(2026, 11, 2, 8, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68/file', 'properties': {}}, 'image_service': } Nov 02 09:47:20 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Trying to clone bba804f6-97e8-4152-9a59-c11b9c7668b0 from image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 at location (None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:47:21 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd" returned: 0 in 0.521s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24712e00-f01e-495a-bdff-96d018ebffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bab2d7-7cb0-43cf-af14-2498f2bedf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd (a641eaef-3ef8-42b7-8f05-c3d4449433fd): created successfully Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29bab2d7-7cb0-43cf-af14-2498f2bedf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (fcaf32bb-1e01-4d59-a8c4-d718c51764d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dc58884f-111e-422d-a923-997effe2055f tempest-TestInstancesWithCinderVolumes-1055599225 None] Created volume successfully. Nov 02 09:47:21 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f7241cc2-6bd6-4288-b79a-6a514e485c20" returned: 0 in 0.832s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-quobyte-f7241cc2-6bd6-4288-b79a-6a514e485c20" released by "delete_volume" :: held 2.174s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Created reservations ['96db62a3-d832-4e9a-a9c9-d4b4a885a8bb', '4920802f-ecef-4cfb-8200-adc813e6aa3e', '633d6f60-0909-457e-a3e7-0375703758a9', '96a6f8d9-5753-4283-b8eb-f2b12b6404fb'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:21 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:47:21 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:22 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.526s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:22 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:47:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Deleted volume successfully. Nov 02 09:47:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b86309f-b999-46fc-b4b6-f1e2715016cc tempest-AttachVolumeNegativeTest-730544798 None] Lock "cinder-f7241cc2-6bd6-4288-b79a-6a514e485c20-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:27 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD, size 20.69 MB, duration 6.37 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:47:27 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Image download 20.69 MB at 3.25 MB/s Nov 02 09:47:27 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[577680af-a7cc-400a-81c2-82605e72389c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:27 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD Nov 02 09:47:27 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:28 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Temporary image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 is fetched for user 2eccaf6d2b17416788ae681bafabbdd8. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97098e4-038f-406f-aa9d-bc07f80247a1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:28 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD Nov 02 09:47:28 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:28 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1510284338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba804f6-97e8-4152-9a59-c11b9c7668b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f7c3f85aae4877b9e09e8aac8ebabb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:19Z,use_quota=True,user_id='2eccaf6d2b17416788ae681bafabbdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f928d74b-9e3a-48c4-bd38-4618f1c106e6),volume_type_id=f928d74b-9e3a-48c4-bd38-4618f1c106e6)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Creating volume bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:28 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:47:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:28 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1073741824 Nov 02 09:47:28 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:29 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1073741824" returned: 0 in 0.604s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:29 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 Nov 02 09:47:29 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:29 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0" returned: 0 in 0.268s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Attempting download of afc7b2d1-41e3-497e-8168-c6cc03a8fb68 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}])) to volume bba804f6-97e8-4152-9a59-c11b9c7668b0. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9678d3-bcfb-4912-8cad-1a8b017e85d7]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:29 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6 Nov 02 09:47:29 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:30 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6" returned: 0 in 0.503s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:30 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6 Nov 02 09:47:30 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:30 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6" returned: 1 in 0.410s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_bhud1pz6' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269294f-b79a-492d-ab3f-4ed2bdd2431a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:30 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD Nov 02 09:47:30 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:31 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:31 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] afc7b2d1-41e3-497e-8168-c6cc03a8fb68 was qcow2, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:47:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:31 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 Nov 02 09:47:31 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:33 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0" returned: 0 in 2.682s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:33 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afc7b2d1-41e3-497e-8168-c6cc03a8fb68_aco82zsbdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:47:33 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Converted 112.00 MB image at 41.70 MB/s Nov 02 09:47:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:33 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1G Nov 02 09:47:33 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:34 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 1G" returned: 0 in 0.405s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Downloaded image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 ((None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}])) to volume bba804f6-97e8-4152-9a59-c11b9c7668b0 successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Temporary image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 for user 2eccaf6d2b17416788ae681bafabbdd8 is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Marking volume bba804f6-97e8-4152-9a59-c11b9c7668b0 as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Copying metadata from image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 to bba804f6-97e8-4152-9a59-c11b9c7668b0. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Creating volume glance metadata for volume bba804f6-97e8-4152-9a59-c11b9c7668b0 backed by image afc7b2d1-41e3-497e-8168-c6cc03a8fb68 with: {'image_id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'image_name': 'tempest-scenario-img--602895320', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b216eb24-5315-477e-8c4d-1a752d6cc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba804f6-97e8-4152-9a59-c11b9c7668b0', 'volume_size': 1, 'image_id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--602895320', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '08f7c3f85aae4877b9e09e8aac8ebabb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'afc7b2d1-41e3-497e-8168-c6cc03a8fb68', 'created_at': datetime.datetime(2026, 11, 2, 8, 47, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 47, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afc7b2d1-41e3-497e-8168-c6cc03a8fb68/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b100563-4992-4449-afa6-3bf37057297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:34 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Volume volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 (bba804f6-97e8-4152-9a59-c11b9c7668b0): created successfully Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b100563-4992-4449-afa6-3bf37057297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Flow 'volume_create_manager' (8d9f3abf-d770-45fd-9440-2574f1054f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d9d0edc3-cd0a-407f-a246-b99043c2db48 tempest-TestInstancesWithCinderVolumes-1055599225 None] Created volume successfully. Nov 02 09:47:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-9e091557-9d4a-4067-be20-b3f27a7e6e60 req-d8ed8ce4-21ff-4dfe-8327-e866f5a3892e tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-9e091557-9d4a-4067-be20-b3f27a7e6e60 req-d8ed8ce4-21ff-4dfe-8327-e866f5a3892e tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-9e091557-9d4a-4067-be20-b3f27a7e6e60 req-d8ed8ce4-21ff-4dfe-8327-e866f5a3892e tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:38 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-9e091557-9d4a-4067-be20-b3f27a7e6e60 req-d8ed8ce4-21ff-4dfe-8327-e866f5a3892e tempest-TestInstancesWithCinderVolumes-1055599225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-bba804f6-97e8-4152-9a59-c11b9c7668b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22e7e66a-f338-495a-85c5-b1d31ce552c5', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:47:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-9e091557-9d4a-4067-be20-b3f27a7e6e60 req-d8ed8ce4-21ff-4dfe-8327-e866f5a3892e tempest-TestInstancesWithCinderVolumes-1055599225 None] attachment_update completed successfully. Nov 02 09:47:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-59a12d36-7ca5-479e-8f00-b6ad3c36b868 tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-575356131: creating Nov 02 09:47:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-59a12d36-7ca5-479e-8f00-b6ad3c36b868 tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-575356131: created successfully Nov 02 09:47:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-59a12d36-7ca5-479e-8f00-b6ad3c36b868 tempest-GroupSnapshotsTest-173869550 None] Create group completed successfully. Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (ffb529ad-2574-409f-8e76-164d7263a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b5061-835a-4d17-a950-bbd8d9610eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491b5061-835a-4d17-a950-bbd8d9610eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-867416364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=166f1213-58a5-4cca-9036-1b747b3f44c9,host='devstack@QuobyteHD#QuobyteHD',id=f5313567-75c2-4495-be1d-868193f5526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:43Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8aa77638-c950-4e21-80f0-6d97778c6018),volume_type_id=8aa77638-c950-4e21-80f0-6d97778c6018)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceca3fb-2ec0-40ea-86db-cf3773068183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceca3fb-2ec0-40ea-86db-cf3773068183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02006c20-02c4-4396-90e0-cfa6ff1d37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02006c20-02c4-4396-90e0-cfa6ff1d37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5313567-75c2-4495-be1d-868193f5526f', 'volume_name': 'volume-f5313567-75c2-4495-be1d-868193f5526f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea910ac3-7d89-47b4-a481-b57239d68363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea910ac3-7d89-47b4-a481-b57239d68363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf06850a-47e1-4c6f-9184-5313d9ca2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:43 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Volume f5313567-75c2-4495-be1d-868193f5526f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5313567-75c2-4495-be1d-868193f5526f', 'volume_size': 1} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=166f1213-58a5-4cca-9036-1b747b3f44c9,created_at=2026-11-02T08:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-867416364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=166f1213-58a5-4cca-9036-1b747b3f44c9,host='devstack@QuobyteHD#QuobyteHD',id=f5313567-75c2-4495-be1d-868193f5526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:47:43Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8aa77638-c950-4e21-80f0-6d97778c6018),volume_type_id=8aa77638-c950-4e21-80f0-6d97778c6018)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Creating volume f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:43 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:43 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f 1073741824 Nov 02 09:47:43 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:43 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f 1073741824" returned: 0 in 0.621s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:43 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:47:43 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:44 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf06850a-47e1-4c6f-9184-5313d9ca2004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5313567-75c2-4495-be1d-868193f5526f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ce9049-5eff-4d69-873a-6671aa0c37df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:47:44 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Volume volume-f5313567-75c2-4495-be1d-868193f5526f (f5313567-75c2-4495-be1d-868193f5526f): created successfully Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ce9049-5eff-4d69-873a-6671aa0c37df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:47:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (ffb529ad-2574-409f-8e76-164d7263a763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:47:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d36cac9f-08fd-4439-916a-a3e04ba01775 tempest-GroupSnapshotsTest-173869550 None] Created volume successfully. Nov 02 09:47:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] GroupSnapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: creating. Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Group snapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: creating. {{(pid=86887) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Creating offline snapshot f3029b2f-07bb-4aef-a984-cee4b8270d27 of volume f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2147c741-4b93-4966-b443-e95e362f9445]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:46 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:47:46 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:46 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.561s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:46 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 1G Nov 02 09:47:46 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:47 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 1G" returned: 0 in 0.633s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5313567-75c2-4495-be1d-868193f5526f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:47 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5313567-75c2-4495-be1d-868193f5526f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:47:47 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:47 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5313567-75c2-4495-be1d-868193f5526f -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.598s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:47 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:47:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:48 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:47:48 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:48 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.506s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:48 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info Nov 02 09:47:48 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:48 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info" returned: 0 in 0.458s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:48 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:47:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:49 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info Nov 02 09:47:49 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:49 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.info" returned: 0 in 0.430s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.339s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-77ba1e50-7cde-45c4-b56f-674297b46b1d tempest-GroupSnapshotsTest-173869550 None] group_snapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: created successfully Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27-3aacf968-6da8-4395-9ae4-8564f28e2227" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27-3aacf968-6da8-4395-9ae4-8564f28e2227" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Creating volume 3aacf968-6da8-4395-9ae4-8564f28e2227 from snapshot f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] snapshot: f3029b2f-07bb-4aef-a984-cee4b8270d27, volume: 3aacf968-6da8-4395-9ae4-8564f28e2227, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e4d825-7ca4-44fa-a7f4-7ca6952495e1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:52 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:47:52 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:52 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.582s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5313567-75c2-4495-be1d-868193f5526f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff0111-40bd-466a-bc21-b67b83bc3f5b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:52 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:47:52 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:53 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.636s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:47:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:47:53 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:47:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:53 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 Nov 02 09:47:53 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-6c982e2a-0a05-47a8-ab6e-7636609fde83 req-d9287146-f693-4750-ab7f-be7506058b86 tempest-TestMinimumBasicScenario-1444018544 None] Terminate volume connection completed successfully. Nov 02 09:47:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-6c982e2a-0a05-47a8-ab6e-7636609fde83 req-d9287146-f693-4750-ab7f-be7506058b86 tempest-TestMinimumBasicScenario-1444018544 None] Deleting attachment 3eef0902-fd06-41e1-925f-3eaec2da23f6. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "cinder-66b68a8d-c22e-491c-93d0-6a8ef3f700ee-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "cinder-66b68a8d-c22e-491c-93d0-6a8ef3f700ee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=68,cinder:UPDATE=60,cinder:DELETE=2,cinder:INSERT=12 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=76,cinder:UPDATE=46,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "cinder-quobyte-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "cinder-quobyte-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" acquired by "delete_volume" :: waited 0.042s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf83928-2921-4a4d-adac-5648c14ba015]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:47:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:57 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee Nov 02 09:47:57 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:58 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:47:58 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:58 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" returned: 0 in 0.783s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:47:58 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee Nov 02 09:47:58 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:47:59 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.918s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:47:59 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" returned: 0 in 1.020s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "cinder-quobyte-66b68a8d-c22e-491c-93d0-6a8ef3f700ee" released by "delete_volume" :: held 1.930s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Created reservations ['7d985a25-389c-4909-99c0-84240564b7f8', '0c98a079-6e0a-4160-9d77-e622d77b7057', '56098d4e-33aa-4551-9042-b3a0d2895e1e', '7fdcfebd-23ff-4ce1-8b4c-10d7cb2e41c9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:47:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:00 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:00 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:00 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.995s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:00 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Deleted volume successfully. Nov 02 09:48:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-26112d6b-4a69-4eff-9fcc-5fe8b53869ef tempest-TestMinimumBasicScenario-1444018544 None] Lock "cinder-66b68a8d-c22e-491c-93d0-6a8ef3f700ee-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:05 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227" returned: 0 in 12.039s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f, size 1024.00 MB, duration 12.04 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:48:05 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Converted 1024.00 MB image at 85.05 MB/s Nov 02 09:48:05 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:05 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 Nov 02 09:48:05 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:05 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227" returned: 0 in 0.417s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" released by "_copy_volume_from_snapshot" :: held 13.853s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27-3aacf968-6da8-4395-9ae4-8564f28e2227" released by "_create_volume_from_snapshot" :: held 13.977s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a4b95450-ba3b-42ad-8e06-0a7386d94945 tempest-GroupSnapshotsTest-173869550 None] Create group from source-snapshot-16825ee8-dc32-4f96-99b6-c83afe247c87 completed successfully. Nov 02 09:48:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e1ba6-d351-4684-933a-a6cd518d702e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:07 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 Nov 02 09:48:07 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:07 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227" returned: 0 in 0.599s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:07 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227 Nov 02 09:48:07 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-4914f241-0bc4-4c1e-aad8-30a05414a605 req-4565139e-6e2f-4a7d-b5f1-7c3b6d145df0 tempest-TestShelveInstance-1798832710 None] Terminate volume connection completed successfully. Nov 02 09:48:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-4914f241-0bc4-4c1e-aad8-30a05414a605 req-4565139e-6e2f-4a7d-b5f1-7c3b6d145df0 tempest-TestShelveInstance-1798832710 None] Deleting attachment 6495ca21-038d-4a24-a396-235c8cddefb1. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:48:08 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3aacf968-6da8-4395-9ae4-8564f28e2227" returned: 0 in 0.392s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-3aacf968-6da8-4395-9ae4-8564f28e2227" released by "delete_volume" :: held 1.072s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Created reservations ['82e27991-c3e1-4b1f-beca-6a6521d814ab'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:08 devstack cinder-volume[86887]: WARNING cinder.quota [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-164632126 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-164632126, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:08 devstack cinder-volume[86887]: WARNING cinder.quota [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-164632126 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-164632126, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Created reservations ['683e2ed1-d8be-428d-99dd-1ff536b5584f', '478bd09d-3215-483c-ab69-572f6080573c', 'a6183b1b-191f-4e6f-b310-748782538498', 'dcf955d5-3f2d-4345-8702-8b543f1dd1d3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:08 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:08 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:08 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.305s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:08 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-126927c0-231c-4856-859a-95f1c4ada86e tempest-GroupSnapshotsTest-173869550 None] Delete group completed successfully. Nov 02 09:48:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] group_snapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: deleting Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] group_snapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: deleting {{(pid=86887) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Deleting offline snapshot f3029b2f-07bb-4aef-a984-cee4b8270d27 of volume f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] snapshot_file for this snap is: volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6f54f-d37f-447a-8299-779e3a326eb9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:09 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:48:09 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:10 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.522s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5313567-75c2-4495-be1d-868193f5526f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd72707-4590-490f-aa08-7d00663921fc]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:10 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:48:10 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:10 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.731s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:11 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:48:11 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5051eb40-0dbc-4b69-a52f-f16d5d9d97ad req-e06fe9a0-8cdf-4c29-8d08-4680ce1e6285 tempest-TestShelveInstance-1798832710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5051eb40-0dbc-4b69-a52f-f16d5d9d97ad req-e06fe9a0-8cdf-4c29-8d08-4680ce1e6285 tempest-TestShelveInstance-1798832710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-5051eb40-0dbc-4b69-a52f-f16d5d9d97ad req-e06fe9a0-8cdf-4c29-8d08-4680ce1e6285 tempest-TestShelveInstance-1798832710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-5051eb40-0dbc-4b69-a52f-f16d5d9d97ad req-e06fe9a0-8cdf-4c29-8d08-4680ce1e6285 tempest-TestShelveInstance-1798832710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-9ceff4ed-0296-4f56-98e5-0e57720821b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df04d6a2-3cc1-4e0e-99f0-3414f209ddc1', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:48:11 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.635s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:11 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27 Nov 02 09:48:11 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-5051eb40-0dbc-4b69-a52f-f16d5d9d97ad req-e06fe9a0-8cdf-4c29-8d08-4680ce1e6285 tempest-TestShelveInstance-1798832710 None] attachment_update completed successfully. Nov 02 09:48:12 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f.f3029b2f-07bb-4aef-a984-cee4b8270d27" returned: 0 in 0.510s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f3029b2f-07bb-4aef-a984-cee4b8270d27" released by "_delete_snapshot" :: held 2.566s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" released by "delete_snapshot" :: held 2.610s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:12 devstack cinder-volume[86887]: WARNING cinder.quota [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-164632126 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-164632126, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:12 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] Created reservations ['e2402662-b5ca-4b23-8dae-f8e9f1144995', '679e08c6-27a8-41ff-82e5-b1994a42d54a', '9c55b9d8-adaa-464e-8d8d-62da7d8f116f', '6208788d-592b-4437-b121-bf6981f7b49f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:12 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-67b17d04-6d33-45b3-98c6-defccb61ee30 tempest-GroupSnapshotsTest-173869550 None] group_snapshot 16825ee8-dc32-4f96-99b6-c83afe247c87: deleted successfully Nov 02 09:48:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" acquired by "delete_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:13 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a75fc2-7d9d-4870-bf24-7380861756d3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:13 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:48:13 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:14 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.631s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:14 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f Nov 02 09:48:14 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:15 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5313567-75c2-4495-be1d-868193f5526f" returned: 0 in 0.865s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-f5313567-75c2-4495-be1d-868193f5526f" released by "delete_volume" :: held 1.629s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Created reservations ['028b17cd-6e71-4a64-b53f-7b5b58817f0d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:15 devstack cinder-volume[86887]: WARNING cinder.db.api [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-164632126'] Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Created reservations ['fdd13553-76e4-4c5d-8dd1-b6165b21cc21', '5f361ec8-08fb-4252-ba48-b3738b148fc8', '7d8a935c-3663-4afd-b969-a8fa3d34917e', 'eae935fa-1db9-4773-9ca4-2f87ac2c93bc'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:15 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:15 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:16 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.629s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:16 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1f39a80d-03b1-451c-9d7b-7e34a9875731 tempest-GroupSnapshotsTest-173869550 None] Delete group completed successfully. Nov 02 09:48:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-7dd00a03-4e6f-4beb-80e2-bdefe874f3cb req-efabb351-4fb5-4fd1-9652-b643bfc9eb66 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-7dd00a03-4e6f-4beb-80e2-bdefe874f3cb req-efabb351-4fb5-4fd1-9652-b643bfc9eb66 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-7dd00a03-4e6f-4beb-80e2-bdefe874f3cb req-efabb351-4fb5-4fd1-9652-b643bfc9eb66 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.083s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-7dd00a03-4e6f-4beb-80e2-bdefe874f3cb req-efabb351-4fb5-4fd1-9652-b643bfc9eb66 tempest-TestInstancesWithCinderVolumes-1055599225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-0a776068-72d4-403c-8a6c-dbaf1b815578', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fba66e1-3245-4295-8857-1feba7955477', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:48:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-432221cb-6a08-46a4-bb61-1080c39135f4 tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-311720695: creating Nov 02 09:48:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-7dd00a03-4e6f-4beb-80e2-bdefe874f3cb req-efabb351-4fb5-4fd1-9652-b643bfc9eb66 tempest-TestInstancesWithCinderVolumes-1055599225 None] attachment_update completed successfully. Nov 02 09:48:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-432221cb-6a08-46a4-bb61-1080c39135f4 tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-311720695: created successfully Nov 02 09:48:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-432221cb-6a08-46a4-bb61-1080c39135f4 tempest-GroupSnapshotsTest-173869550 None] Create group completed successfully. Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (f09eda7a-a5fa-41cd-bc20-fb9880f18f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b09e22-b8ec-4ad0-8d96-c37d785b62b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b09e22-b8ec-4ad0-8d96-c37d785b62b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-178972103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49043253-b09a-4e36-9658-f904ae687a25,host='devstack@QuobyteHD#QuobyteHD',id=c12edbe2-b838-4bd3-9697-a7a2e6ae6e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:20Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad),volume_type_id=8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399879dc-9d48-4ac8-a250-bd60a58ba21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399879dc-9d48-4ac8-a250-bd60a58ba21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc23a1a-857a-4245-a628-0f283ecfef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc23a1a-857a-4245-a628-0f283ecfef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12edbe2-b838-4bd3-9697-a7a2e6ae6e65', 'volume_name': 'volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3636703d-4096-49c4-945b-54239974617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3636703d-4096-49c4-945b-54239974617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae03177-ef37-48c4-83fb-71e5c8f05701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Volume c12edbe2-b838-4bd3-9697-a7a2e6ae6e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65', 'volume_size': 1} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49043253-b09a-4e36-9658-f904ae687a25,created_at=2026-11-02T08:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-178972103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49043253-b09a-4e36-9658-f904ae687a25,host='devstack@QuobyteHD#QuobyteHD',id=c12edbe2-b838-4bd3-9697-a7a2e6ae6e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:20Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad),volume_type_id=8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Creating volume c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:48:20 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:48:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:20 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 1073741824 Nov 02 09:48:20 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:21 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 1073741824" returned: 0 in 0.935s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:21 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 Nov 02 09:48:21 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:21 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" returned: 0 in 0.522s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae03177-ef37-48c4-83fb-71e5c8f05701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b15fdf4-43cf-4171-9660-12b1f8a89b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Volume volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 (c12edbe2-b838-4bd3-9697-a7a2e6ae6e65): created successfully Nov 02 09:48:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b15fdf4-43cf-4171-9660-12b1f8a89b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (f09eda7a-a5fa-41cd-bc20-fb9880f18f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3f5576f5-cfc0-4a92-835f-b9478de18dc2 tempest-GroupSnapshotsTest-173869550 None] Created volume successfully. Nov 02 09:48:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-6b274866-917d-47b7-af5c-763c5f465a75 req-d27f2b93-b7e0-4248-9edf-6437ba22c57e tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-6b274866-917d-47b7-af5c-763c5f465a75 req-d27f2b93-b7e0-4248-9edf-6437ba22c57e tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-6b274866-917d-47b7-af5c-763c5f465a75 req-d27f2b93-b7e0-4248-9edf-6437ba22c57e tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-6b274866-917d-47b7-af5c-763c5f465a75 req-d27f2b93-b7e0-4248-9edf-6437ba22c57e tempest-TestInstancesWithCinderVolumes-1055599225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30059165-e7a0-4f44-b4e6-be37eb61204f', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:48:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-6b274866-917d-47b7-af5c-763c5f465a75 req-d27f2b93-b7e0-4248-9edf-6437ba22c57e tempest-TestInstancesWithCinderVolumes-1055599225 None] attachment_update completed successfully. Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (063d58fd-7798-4403-abe8-9d3267edb645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaf3934-25ff-4834-8172-2d9636887cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbaf3934-25ff-4834-8172-2d9636887cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422309407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49043253-b09a-4e36-9658-f904ae687a25,host='devstack@QuobyteHD#QuobyteHD',id=6262c27f-0199-4e7c-a19b-4c89c010ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:24Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad),volume_type_id=8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db739d1-f130-413f-8c80-3d2115f46fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db739d1-f130-413f-8c80-3d2115f46fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5485119-e59d-4842-852a-7c7a8615bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5485119-e59d-4842-852a-7c7a8615bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6262c27f-0199-4e7c-a19b-4c89c010ffc9', 'volume_name': 'volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a81585-2122-4ce7-87dd-33bf2cbcf131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a81585-2122-4ce7-87dd-33bf2cbcf131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3573bc47-240a-45c7-8a80-8215f984940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Volume 6262c27f-0199-4e7c-a19b-4c89c010ffc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9', 'volume_size': 1} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49043253-b09a-4e36-9658-f904ae687a25,created_at=2026-11-02T08:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422309407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49043253-b09a-4e36-9658-f904ae687a25,host='devstack@QuobyteHD#QuobyteHD',id=6262c27f-0199-4e7c-a19b-4c89c010ffc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:24Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad),volume_type_id=8cb870c1-b83a-4aa1-9c79-62ab3f5aa1ad)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Creating volume 6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:48:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:48:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:23 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 1073741824 Nov 02 09:48:23 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:24 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 1073741824" returned: 0 in 0.692s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:24 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 Nov 02 09:48:24 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:25 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3573bc47-240a-45c7-8a80-8215f984940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecea9b0-09f2-42c6-bbc2-58cbfb5f5c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Volume volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 (6262c27f-0199-4e7c-a19b-4c89c010ffc9): created successfully Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecea9b0-09f2-42c6-bbc2-58cbfb5f5c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (063d58fd-7798-4403-abe8-9d3267edb645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7d47a3dc-1160-4569-aeab-c7b87fca3bc7 tempest-GroupSnapshotsTest-173869550 None] Created volume successfully. Nov 02 09:48:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3d532204-5866-46e2-a5c2-eae8f2d6675b tempest-GroupSnapshotsTest-173869550 None] Update group completed successfully. Nov 02 09:48:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-69d43370-ea6d-435c-8b75-1798f8917eab tempest-GroupSnapshotsTest-173869550 None] Update group completed successfully. Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Flow 'volume_create_manager' (ec9ed549-74a9-433e-94e4-bf2fc9c292a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4cabe7-e25a-45f6-8a57-33610704e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4cabe7-e25a-45f6-8a57-33610704e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2090323004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a2b8bf-0ee0-4748-919e-59bc14e64900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c49b0bb33994214bad896be90fade46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:29Z,use_quota=True,user_id='ef19d819163442df8a2d2ad9fd946d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4b6242-57c1-4542-a333-1c054640efbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4b6242-57c1-4542-a333-1c054640efbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e0e6f-da6e-4d55-9bc8-44885e77d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32e0e6f-da6e-4d55-9bc8-44885e77d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a2b8bf-0ee0-4748-919e-59bc14e64900', 'volume_name': 'volume-29a2b8bf-0ee0-4748-919e-59bc14e64900', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c77fa19-b138-41b7-89aa-55db9002e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c77fa19-b138-41b7-89aa-55db9002e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be9e3e6-aaac-4800-82d3-a16243da0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:29 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Volume 29a2b8bf-0ee0-4748-919e-59bc14e64900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a2b8bf-0ee0-4748-919e-59bc14e64900', 'volume_size': 1} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2090323004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a2b8bf-0ee0-4748-919e-59bc14e64900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c49b0bb33994214bad896be90fade46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:29Z,use_quota=True,user_id='ef19d819163442df8a2d2ad9fd946d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Creating volume 29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:48:29 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:29 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 1073741824 Nov 02 09:48:29 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:29 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8e6badcf-acda-4364-aceb-ab1e3a2b7654 tempest-GroupSnapshotsTest-173869550 None] Update group completed successfully. Nov 02 09:48:29 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:29 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-152ec917-ca74-4477-9609-a19e149a0cd8 req-37fd511a-949f-4565-9801-d4fec48ca135 tempest-TestInstancesWithCinderVolumes-1055599225 None] Terminate volume connection completed successfully. Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-152ec917-ca74-4477-9609-a19e149a0cd8 req-37fd511a-949f-4565-9801-d4fec48ca135 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleting attachment 7fba66e1-3245-4295-8857-1feba7955477. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:48:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 1073741824" returned: 0 in 0.639s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:30 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:30 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:30 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be9e3e6-aaac-4800-82d3-a16243da0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a2b8bf-0ee0-4748-919e-59bc14e64900', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff22b200-b6df-4801-bb24-747ae280e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:30 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Volume volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 (29a2b8bf-0ee0-4748-919e-59bc14e64900): created successfully Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff22b200-b6df-4801-bb24-747ae280e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Flow 'volume_create_manager' (ec9ed549-74a9-433e-94e4-bf2fc9c292a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-32179890-0ffb-4c53-98e1-c2a19cc0c194 tempest-VolumeDependencyTests-1896639336 None] Created volume successfully. Nov 02 09:48:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bd825302-3e32-4fe1-baab-9597423fa311 tempest-GroupSnapshotsTest-173869550 None] Update group completed successfully. Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-0a776068-72d4-403c-8a6c-dbaf1b815578-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-0a776068-72d4-403c-8a6c-dbaf1b815578-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-quobyte-0a776068-72d4-403c-8a6c-dbaf1b815578" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-0a776068-72d4-403c-8a6c-dbaf1b815578" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ea232-384a-409f-b343-c4e15e9d9b30]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:30 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 Nov 02 09:48:30 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:31 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578" returned: 0 in 0.454s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:31 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578 Nov 02 09:48:31 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Creating offline snapshot 7212f174-cf8f-427f-b848-f1dc8e5bfae4 of volume 29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d54f4-5d7e-4b57-bc41-86445bb9a04c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:31 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0a776068-72d4-403c-8a6c-dbaf1b815578" returned: 0 in 0.544s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-0a776068-72d4-403c-8a6c-dbaf1b815578" released by "delete_volume" :: held 1.090s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:31 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:31 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:31 devstack cinder-volume[86887]: WARNING cinder.quota [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256366117-1121617391 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256366117-1121617391, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:31 devstack cinder-volume[86887]: WARNING cinder.quota [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256366117-1121617391 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1256366117-1121617391, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Created reservations ['d9d4316f-1c01-4d19-bff6-6f7fab5d4819', '597cd8b0-52cc-4657-bd59-a9006bf77c2b', 'fd3ee3e0-7a45-4bfc-83e8-6c5435bb8c59', '269bf6de-859d-458a-9fb4-4e4744a11751'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] GroupSnapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: creating. Nov 02 09:48:32 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:32 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Group snapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: creating. {{(pid=86887) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:32 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.830s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:32 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 1G Nov 02 09:48:32 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:32 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.412s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleted volume successfully. Nov 02 09:48:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b81a598c-4d00-4548-9a28-40c996726198 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-0a776068-72d4-403c-8a6c-dbaf1b815578-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:32 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 1G" returned: 0 in 0.511s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:33 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:33 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:33 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.319s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:33 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 is being set with open permissions: ugo+rw Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:33 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:33 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:33 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:33 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info Nov 02 09:48:33 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:33 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info" returned: 0 in 0.319s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:34 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info is being set with open permissions: ugo+rw Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:34 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info Nov 02 09:48:34 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:34 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.info" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.969s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Creating offline snapshot 0a35ae6a-264b-43fc-8ab7-f4144891c967 of volume 6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:48:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-20c5623d-d82b-4330-bcee-6fa7fef0f830 tempest-VolumeDependencyTests-1896639336 None] Create snapshot completed successfully Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dff738-dbb8-43ac-bbd7-e19af1c5174a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:34 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 Nov 02 09:48:34 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:34 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9" returned: 0 in 0.536s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:34 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 1G Nov 02 09:48:34 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:35 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 1G" returned: 0 in 0.760s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:35 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 Nov 02 09:48:35 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Flow 'volume_create_manager' (e6f232f9-7756-4aca-a694-17ac4e1af69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fca117-b6c7-4bb7-a1bb-1087d73e9990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fca117-b6c7-4bb7-a1bb-1087d73e9990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-381857570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fb6746-d57e-4b22-8398-a17de7c42591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c49b0bb33994214bad896be90fade46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7212f174-cf8f-427f-b848-f1dc8e5bfae4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:36Z,use_quota=True,user_id='ef19d819163442df8a2d2ad9fd946d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5b5e3-5a8c-4504-8775-173e75d79191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b5b5e3-5a8c-4504-8775-173e75d79191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd3489b-c34d-41a4-b5fa-a8ef7918d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd3489b-c34d-41a4-b5fa-a8ef7918d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '92fb6746-d57e-4b22-8398-a17de7c42591', 'volume_name': 'volume-92fb6746-d57e-4b22-8398-a17de7c42591', 'volume_size': 1, 'snapshot_id': '7212f174-cf8f-427f-b848-f1dc8e5bfae4'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c70e1-1ab3-411c-9047-b7a1331d9549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0c70e1-1ab3-411c-9047-b7a1331d9549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4997e1b-756d-4c2d-9acc-8ac41c83451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:36 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Volume 92fb6746-d57e-4b22-8398-a17de7c42591: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-92fb6746-d57e-4b22-8398-a17de7c42591', 'volume_size': 1, 'snapshot_id': '7212f174-cf8f-427f-b848-f1dc8e5bfae4'} Nov 02 09:48:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-2dce503c-cc28-4f36-ab08-f82d7fa9baec req-dfb88f4f-96eb-4fe4-b54f-ecdbf28e80f6 tempest-TestInstancesWithCinderVolumes-1055599225 None] Terminate volume connection completed successfully. Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-2dce503c-cc28-4f36-ab08-f82d7fa9baec req-dfb88f4f-96eb-4fe4-b54f-ecdbf28e80f6 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleting attachment 30059165-e7a0-4f44-b4e6-be37eb61204f. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:36 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967" returned: 0 in 0.391s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:36 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:36 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 Nov 02 09:48:36 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:36 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:36 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info Nov 02 09:48:36 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-a641eaef-3ef8-42b7-8f05-c3d4449433fd-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-a641eaef-3ef8-42b7-8f05-c3d4449433fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-quobyte-a641eaef-3ef8-42b7-8f05-c3d4449433fd" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-a641eaef-3ef8-42b7-8f05-c3d4449433fd" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16075ca-e567-4304-b530-d39e7275e81a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:36 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:36 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:36 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info Nov 02 09:48:36 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:36 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd Nov 02 09:48:36 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:37 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.info" returned: 0 in 0.339s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.843s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Creating offline snapshot b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 of volume c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:48:37 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf0e7d4-37d2-4010-a36d-8d76f286f230]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:37 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd Nov 02 09:48:37 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:37 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 Nov 02 09:48:37 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:37 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a641eaef-3ef8-42b7-8f05-c3d4449433fd" returned: 0 in 0.335s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-a641eaef-3ef8-42b7-8f05-c3d4449433fd" released by "delete_volume" :: held 0.920s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:37 devstack cinder-volume[86887]: WARNING cinder.quota [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1713468243-1497930731 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1713468243-1497930731, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:37 devstack cinder-volume[86887]: WARNING cinder.quota [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1713468243-1497930731 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1713468243-1497930731, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Created reservations ['3a85a782-f9b5-4a34-9ec9-fa8039bc1549', '343f84da-ebf2-412d-8bdd-008871a453d0', '761fa6e7-b44c-4970-9b0c-f6c868171c96', '2bd713e7-6ffe-49d0-a8af-d7e92e1c60e4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:37 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:37 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 1G Nov 02 09:48:37 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:37 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:37 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:38 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.362s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleted volume successfully. Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8116e34a-44d9-403b-a3e5-8c1eb745c283 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-a641eaef-3ef8-42b7-8f05-c3d4449433fd-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:38 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 1G" returned: 0 in 0.651s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:38 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 Nov 02 09:48:38 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:38 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" returned: 0 in 0.458s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:38 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:38 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 Nov 02 09:48:38 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:39 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" returned: 0 in 0.283s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:39 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info Nov 02 09:48:39 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:39 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info" returned: 0 in 0.291s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:39 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:39 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info Nov 02 09:48:39 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:39 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.info" returned: 0 in 0.368s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.778s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4-92fb6746-d57e-4b22-8398-a17de7c42591" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4-92fb6746-d57e-4b22-8398-a17de7c42591" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Creating volume 92fb6746-d57e-4b22-8398-a17de7c42591 from snapshot 7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] snapshot: 7212f174-cf8f-427f-b848-f1dc8e5bfae4, volume: 92fb6746-d57e-4b22-8398-a17de7c42591, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d506d-20a8-41c4-b670-6b1461670102]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cbc803ae-fb73-4e97-86b1-713c91b3d222 tempest-GroupSnapshotsTest-173869550 None] group_snapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: created successfully Nov 02 09:48:40 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:40 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:40 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.549s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a2b8bf-0ee0-4748-919e-59bc14e64900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b3f964-c483-433b-923c-af48473dcf25]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:40 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:40 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] group_snapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: deleting Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] group_snapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: deleting {{(pid=86887) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-0a35ae6a-264b-43fc-8ab7-f4144891c967" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:41 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.602s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-0a35ae6a-264b-43fc-8ab7-f4144891c967" acquired by "_delete_snapshot" :: waited 0.082s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Deleting offline snapshot 0a35ae6a-264b-43fc-8ab7-f4144891c967 of volume 6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:48:41 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 Nov 02 09:48:41 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] snapshot_file for this snap is: volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f131e2-3473-4405-8a04-4cadc8df927f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:41 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 Nov 02 09:48:41 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-81502b9a-3626-487d-8321-91c3d447a96a req-7f6d5a6d-0ad2-4aa0-b62b-93ca8105b559 tempest-TestInstancesWithCinderVolumes-1055599225 None] Terminate volume connection completed successfully. Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-81502b9a-3626-487d-8321-91c3d447a96a req-7f6d5a6d-0ad2-4aa0-b62b-93ca8105b559 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleting attachment 22e7e66a-f338-495a-85c5-b1d31ce552c5. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:48:41 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967" returned: 0 in 0.528s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff8798-2e20-458a-abd2-896e04b9f414]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:42 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 Nov 02 09:48:42 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:42 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9" returned: 0 in 1.041s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:42 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 Nov 02 09:48:42 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:43 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967" returned: 0 in 0.705s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:43 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967 Nov 02 09:48:43 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:44 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9.0a35ae6a-264b-43fc-8ab7-f4144891c967" returned: 0 in 0.507s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-0a35ae6a-264b-43fc-8ab7-f4144891c967" released by "_delete_snapshot" :: held 3.024s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" released by "delete_snapshot" :: held 3.124s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-bba804f6-97e8-4152-9a59-c11b9c7668b0-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-bba804f6-97e8-4152-9a59-c11b9c7668b0-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Deleting offline snapshot b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 of volume c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] snapshot_file for this snap is: volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266aefe-fa53-4aee-a1b6-d383a028bbad]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "cinder-quobyte-bba804f6-97e8-4152-9a59-c11b9c7668b0" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-bba804f6-97e8-4152-9a59-c11b9c7668b0" acquired by "delete_volume" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5983344-0273-4891-a01a-4c18ec2e7a61]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:44 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 Nov 02 09:48:44 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:45 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 Nov 02 09:48:45 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:45 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" returned: 0 in 1.028s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5629aa4a-b84f-4c79-a1a2-09b3a0d8d8b4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:45 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0" returned: 0 in 1.008s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:45 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0 Nov 02 09:48:45 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:45 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 Nov 02 09:48:45 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:46 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" returned: 0 in 0.822s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:46 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bba804f6-97e8-4152-9a59-c11b9c7668b0" returned: 0 in 0.745s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-quobyte-bba804f6-97e8-4152-9a59-c11b9c7668b0" released by "delete_volume" :: held 1.886s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:46 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 Nov 02 09:48:46 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:46 devstack cinder-volume[86887]: WARNING cinder.quota [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976673635-2051060563 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976673635-2051060563, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:46 devstack cinder-volume[86887]: WARNING cinder.quota [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976673635-2051060563 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1976673635-2051060563, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Created reservations ['45aba2f7-30ec-4570-9e19-1f6747c6eddd', '304be5df-dab3-4aa5-88b5-fff6411cad32', '5b22491d-88c9-4244-8945-b3b6d34ae639', '57f40ce5-2701-4b7a-8670-31679aaf24be'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:46 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:46 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:47 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.421s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Deleted volume successfully. Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e722bfa1-3fcc-48f7-8aa6-7148fc304106 tempest-TestInstancesWithCinderVolumes-1055599225 None] Lock "cinder-bba804f6-97e8-4152-9a59-c11b9c7668b0-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:47 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" returned: 0 in 0.848s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:47 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4 Nov 02 09:48:47 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:47 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65.b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-b2c7d44a-f5b2-4348-8c1c-d960f11bdcd4" released by "_delete_snapshot" :: held 3.423s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" released by "delete_snapshot" :: held 3.491s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:48 devstack cinder-volume[86887]: WARNING cinder.quota [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1213744592 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1213744592, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:48 devstack cinder-volume[86887]: WARNING cinder.quota [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1213744592 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1213744592, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Created reservations ['2f61f39d-ad74-4757-98eb-8b4456b62339', '9d1be194-ec36-4c80-b8e0-e608c01cbfaa', 'b57b83b4-bef1-44a8-acd5-0bb5d3351c6e', 'e1e442f6-7387-4c67-8a4b-49a4cc23b04e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] Created reservations ['6011fd0c-55da-4fa9-b521-4e50aa4f9c49', 'd5058a4a-7cd4-47de-8834-f40c4acba6ab', '161eb969-a9e3-4381-ae3b-f7a74fdcad6f', '0e318efe-562a-406d-8264-b3e7415eb1a0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e3431298-22d5-4e29-9071-f988feef721b tempest-GroupSnapshotsTest-173869550 None] group_snapshot 1b2472b8-8c59-4f17-87d5-422278922ec2: deleted successfully Nov 02 09:48:49 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591" returned: 0 in 8.473s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:49 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:48:49 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Converted 1024.00 MB image at 120.85 MB/s Nov 02 09:48:49 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 is being set with open permissions: ugo+rw Nov 02 09:48:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:49 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 Nov 02 09:48:49 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:50 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" released by "_copy_volume_from_snapshot" :: held 10.167s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[424418a6-97da-4908-a89f-a0a01f7f23cd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4-92fb6746-d57e-4b22-8398-a17de7c42591" released by "_create_volume_from_snapshot" :: held 10.284s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.353s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4997e1b-756d-4c2d-9acc-8ac41c83451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fb6746-d57e-4b22-8398-a17de7c42591', 'volume_size': 1, 'snapshot_id': '7212f174-cf8f-427f-b848-f1dc8e5bfae4'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f7d91-4b0a-4756-b74a-ec8e8000e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Volume volume-92fb6746-d57e-4b22-8398-a17de7c42591 (92fb6746-d57e-4b22-8398-a17de7c42591): created successfully Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63f7d91-4b0a-4756-b74a-ec8e8000e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Flow 'volume_create_manager' (e6f232f9-7756-4aca-a694-17ac4e1af69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:50 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 Nov 02 09:48:50 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f906426a-4c80-49b5-8fe8-77e88973e722 tempest-VolumeDependencyTests-1896639336 None] Created volume successfully. Nov 02 09:48:50 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9" returned: 0 in 0.459s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:50 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9 Nov 02 09:48:50 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-7212f174-cf8f-427f-b848-f1dc8e5bfae4-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-7212f174-cf8f-427f-b848-f1dc8e5bfae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Deleting offline snapshot 7212f174-cf8f-427f-b848-f1dc8e5bfae4 of volume 29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] snapshot_file for this snap is: volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66d8a5d-c70e-4d63-b513-952190a9c714]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:50 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6262c27f-0199-4e7c-a19b-4c89c010ffc9" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:50 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:50 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-6262c27f-0199-4e7c-a19b-4c89c010ffc9" released by "delete_volume" :: held 0.887s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[31966d72-4d4d-4797-a84c-89bb579062f1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:51 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 Nov 02 09:48:51 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:51 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.482s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29a2b8bf-0ee0-4748-919e-59bc14e64900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80283cb-4e77-4e74-95e2-6f55dee1a097]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:51 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:51 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:51 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" returned: 0 in 0.461s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:51 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65 Nov 02 09:48:51 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:51 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" returned: 0 in 0.277s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-c12edbe2-b838-4bd3-9697-a7a2e6ae6e65" released by "delete_volume" :: held 0.832s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Created reservations ['a29e5362-07bc-496a-b1b3-1cc4b4123b2f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:51 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.652s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:51 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:51 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:51 devstack cinder-volume[86887]: WARNING cinder.quota [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1213744592 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1213744592, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Created reservations ['12f40f7f-cb6d-482c-8386-996b6223943e', '53efb76b-1716-4864-8c36-bf0ce38dda1b', '12e0aa3d-3ab0-4f6a-a404-6201aa05a53d', '25147cd6-0a04-48b6-b293-5f9f7dda1c2b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Created reservations ['fa2a7fad-690b-4ab3-bddc-5a0f89a4a2ea', 'd09df3e3-c503-4b7e-b814-b9bd557a6fb2', 'a1e853d0-7ff8-4801-aa92-c325ab1a8772', '88fca806-fa59-4f63-a544-55a879251fbf'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:52 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:52 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:52 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.463s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:52 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4 Nov 02 09:48:52 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:52 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.337s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8d449400-c183-4743-a77a-5086b041a7cf tempest-GroupSnapshotsTest-173869550 None] Delete group completed successfully. Nov 02 09:48:52 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900.7212f174-cf8f-427f-b848-f1dc8e5bfae4" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-7212f174-cf8f-427f-b848-f1dc8e5bfae4" released by "_delete_snapshot" :: held 2.138s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" released by "delete_snapshot" :: held 2.180s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:52 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Created reservations ['fc8a76cb-dc3b-44f2-9c62-f933cc23a1c7', '6528a606-24d2-4d4d-938f-b83e1813ae14', '1d7a6baa-1030-4ae7-a65c-88796c37ae84', 'caa84858-3460-439d-b6fa-b44f83673bfb'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Delete snapshot completed successfully. Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b685d77-df29-4673-8e19-ca73b36dd653 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-7212f174-cf8f-427f-b848-f1dc8e5bfae4-delete_snapshot" released by "delete_snapshot" :: held 2.440s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-143dd5e5-ca3c-445b-b4a5-fa28f02686ba tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-1198743123: creating Nov 02 09:48:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-143dd5e5-ca3c-445b-b4a5-fa28f02686ba tempest-GroupSnapshotsTest-173869550 None] Group tempest-GroupSnapshotsTest-Group-1198743123: created successfully Nov 02 09:48:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-143dd5e5-ca3c-445b-b4a5-fa28f02686ba tempest-GroupSnapshotsTest-173869550 None] Create group completed successfully. Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-29a2b8bf-0ee0-4748-919e-59bc14e64900-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-29a2b8bf-0ee0-4748-919e-59bc14e64900-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f522408a-50b7-4811-b57f-1239fb40fcb9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:54 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:54 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:54 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.652s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:54 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900 Nov 02 09:48:54 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:54 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-29a2b8bf-0ee0-4748-919e-59bc14e64900" returned: 0 in 0.345s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-29a2b8bf-0ee0-4748-919e-59bc14e64900" released by "delete_volume" :: held 1.101s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Created reservations ['e9f5ace0-2fab-4e30-a265-30c4f4191461', '02a21485-64f2-4f8f-b286-002aa6e649d1', 'b9e43868-2040-4d45-ac32-ea329f155b7b', 'eed771ae-e9f3-4818-905a-8b1eee3afb01'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (03271972-c742-43c3-8fda-94849db8ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9eb6ec-1049-40d6-8daa-b5aaf0e0c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9eb6ec-1049-40d6-8daa-b5aaf0e0c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1031604628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2623a7fe-b86b-4153-be3e-afbb86dd7bb3,host='devstack@QuobyteHD#QuobyteHD',id=8172d10b-120c-41cf-a277-889e53dd5cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:55Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79eaba30-f43e-4c3b-9a32-0c8b99f4a7a3),volume_type_id=79eaba30-f43e-4c3b-9a32-0c8b99f4a7a3)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5ea12a-7808-48fc-a1e8-40e89d53a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5ea12a-7808-48fc-a1e8-40e89d53a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af76da6-e220-42dc-b41f-1dffa0100576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af76da6-e220-42dc-b41f-1dffa0100576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8172d10b-120c-41cf-a277-889e53dd5cc2', 'volume_name': 'volume-8172d10b-120c-41cf-a277-889e53dd5cc2', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cee031-253a-43ad-a7f7-d5e41fdaf348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cee031-253a-43ad-a7f7-d5e41fdaf348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213990b-7bf4-4eac-82b0-4e2a55560825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Volume 8172d10b-120c-41cf-a277-889e53dd5cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8172d10b-120c-41cf-a277-889e53dd5cc2', 'volume_size': 1} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2623a7fe-b86b-4153-be3e-afbb86dd7bb3,created_at=2026-11-02T08:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1031604628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2623a7fe-b86b-4153-be3e-afbb86dd7bb3,host='devstack@QuobyteHD#QuobyteHD',id=8172d10b-120c-41cf-a277-889e53dd5cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011d6fce6cc14a92be22bb5e97513e0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:48:55Z,use_quota=True,user_id='7c396f27559c49b8b72c17320f61701b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79eaba30-f43e-4c3b-9a32-0c8b99f4a7a3),volume_type_id=79eaba30-f43e-4c3b-9a32-0c8b99f4a7a3)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Creating volume 8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:48:55 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:55 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 1073741824 Nov 02 09:48:55 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:55 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:55 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:55 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.320s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Deleted volume successfully. Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c6c141e1-c83f-44cc-be03-33bcb5470ba6 tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-29a2b8bf-0ee0-4748-919e-59bc14e64900-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:55 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 1073741824" returned: 0 in 0.607s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:56 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 Nov 02 09:48:56 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-92fb6746-d57e-4b22-8398-a17de7c42591-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-92fb6746-d57e-4b22-8398-a17de7c42591-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:56 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2" returned: 0 in 0.268s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b213990b-7bf4-4eac-82b0-4e2a55560825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8172d10b-120c-41cf-a277-889e53dd5cc2', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3870147a-8d67-48ed-9ce2-4dd028e7c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:48:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Volume volume-8172d10b-120c-41cf-a277-889e53dd5cc2 (8172d10b-120c-41cf-a277-889e53dd5cc2): created successfully Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3870147a-8d67-48ed-9ce2-4dd028e7c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Flow 'volume_create_manager' (03271972-c742-43c3-8fda-94849db8ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:48:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dea68a36-2716-4ebc-a68d-db0e91f4d312 tempest-GroupSnapshotsTest-173869550 None] Created volume successfully. Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f00659-2675-4f0f-b879-1c342806bf1f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:56 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 Nov 02 09:48:56 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:56 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] GroupSnapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: creating. Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591" returned: 0 in 0.535s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:56 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591 Nov 02 09:48:56 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Group snapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: creating. {{(pid=86887) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Creating offline snapshot 9df38cfe-6641-4978-aa8f-67a3d5d583f2 of volume 8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e3175c-5254-4aa4-8ad7-704f7b7e62f9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:57 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 Nov 02 09:48:57 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:57 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-92fb6746-d57e-4b22-8398-a17de7c42591" returned: 0 in 0.385s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-quobyte-92fb6746-d57e-4b22-8398-a17de7c42591" released by "delete_volume" :: held 0.987s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=159,cinder:INSERT=32,cinder:UPDATE=131,cinder:DELETE=6 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Created reservations ['d26a941f-77de-4f40-9bf1-f4d649ee6417', '2b888b41-14b1-4dcf-8ac2-0b6141cd9a47', '41227f64-6cb2-4e35-8639-cc63c6504390', '03c279af-1144-48dc-9ab9-e7bba680513f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=132,cinder:INSERT=36,cinder:UPDATE=147,cinder:DELETE=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:57 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:57 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:57 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2" returned: 0 in 0.585s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:57 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 1G Nov 02 09:48:57 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:57 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Deleted volume successfully. Nov 02 09:48:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5fe02fc3-136f-4cb5-a5bf-ccaa38d654fb tempest-VolumeDependencyTests-1896639336 None] Lock "cinder-92fb6746-d57e-4b22-8398-a17de7c42591-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:58 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:48:58 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:58 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 1G" returned: 0 in 0.719s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172d10b-120c-41cf-a277-889e53dd5cc2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:58 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172d10b-120c-41cf-a277-889e53dd5cc2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 Nov 02 09:48:58 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:58 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.469s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:48:58 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172d10b-120c-41cf-a277-889e53dd5cc2 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2" returned: 0 in 0.558s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:58 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:59 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 Nov 02 09:48:59 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:59 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:59 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info Nov 02 09:48:59 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:48:59 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Nov 02 09:48:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info" returned: 0 in 0.365s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:48:59 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 09:48:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:48:59 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info Nov 02 09:48:59 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-a14d7cb3-51f9-4303-8a99-301e87ad48cd tempest-TestShelveInstance-1798832710 None] Terminate volume connection completed successfully. Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-a14d7cb3-51f9-4303-8a99-301e87ad48cd tempest-TestShelveInstance-1798832710 None] Deleting attachment df04d6a2-3cc1-4e0e-99f0-3414f209ddc1. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:49:00 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.info" returned: 0 in 0.438s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cb7b4a56-3b70-4497-8c0b-8347ae9135c9 tempest-GroupSnapshotsTest-173869550 None] group_snapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: created successfully Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Acquiring lock "cinder-9ceff4ed-0296-4f56-98e5-0e57720821b5-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "cinder-9ceff4ed-0296-4f56-98e5-0e57720821b5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Acquiring lock "cinder-quobyte-9ceff4ed-0296-4f56-98e5-0e57720821b5" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "cinder-quobyte-9ceff4ed-0296-4f56-98e5-0e57720821b5" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfaf24e-e141-4057-b873-c140e3ee0e9b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:00 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 Nov 02 09:49:00 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:01 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5" returned: 0 in 0.658s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:01 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5 Nov 02 09:49:01 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] group_snapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: deleting Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] group_snapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: deleting {{(pid=86887) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-9df38cfe-6641-4978-aa8f-67a3d5d583f2" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-9df38cfe-6641-4978-aa8f-67a3d5d583f2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Deleting offline snapshot 9df38cfe-6641-4978-aa8f-67a3d5d583f2 of volume 8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] snapshot_file for this snap is: volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc402da-9808-44a3-aeda-3b218797b8c2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:01 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ceff4ed-0296-4f56-98e5-0e57720821b5" returned: 0 in 0.413s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "cinder-quobyte-9ceff4ed-0296-4f56-98e5-0e57720821b5" released by "delete_volume" :: held 1.154s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.quota [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Created reservations ['4fa5a596-bc03-43e3-9cfd-47bb1f08eb28', 'daf79000-a6ed-43cb-ac1d-a65dadb1e548', '0afc2ef0-8769-4625-a60b-c382841f4214', '57e46764-abec-4ec1-baae-5ec8133f2293'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:01 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 Nov 02 09:49:01 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:02 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:49:02 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:02 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.421s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG cinder.manager [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:49:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Deleted volume successfully. Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [req-023c31d4-b62b-47f5-830d-a8ba1c5792b7 req-1bafed71-513f-4bc4-8ea8-7e872bc7f9ed tempest-TestShelveInstance-1798832710 None] Lock "cinder-9ceff4ed-0296-4f56-98e5-0e57720821b5-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:02 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2" returned: 0 in 0.879s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8172d10b-120c-41cf-a277-889e53dd5cc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65857b9-5dfc-4b43-a48d-88e313374089]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:02 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 Nov 02 09:49:02 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:03 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2" returned: 0 in 0.637s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:03 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 Nov 02 09:49:03 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:03 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2" returned: 0 in 0.599s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:03 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2 Nov 02 09:49:03 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:04 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2.9df38cfe-6641-4978-aa8f-67a3d5d583f2" returned: 0 in 0.322s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-9df38cfe-6641-4978-aa8f-67a3d5d583f2" released by "_delete_snapshot" :: held 2.614s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" released by "delete_snapshot" :: held 2.652s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:04 devstack cinder-volume[86887]: WARNING cinder.quota [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1484173415 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1484173415, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:49:04 devstack cinder-volume[86887]: WARNING cinder.quota [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1484173415 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1484173415, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:49:04 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] Created reservations ['8c1f0a04-2e9b-4a95-8537-2423a8a3afe3', '323e6fe4-89c0-4150-8e31-0abd71af4157', 'cc49bf6d-7d2a-4db1-9b09-3e5e35402acf', '599647e7-7e87-4287-8f55-ecb6e248aa85'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7c8f650e-4958-4b5b-b034-1af1a552a74d tempest-GroupSnapshotsTest-173869550 None] group_snapshot 358fc9dd-e44a-4aac-b659-5aad7e847558: deleted successfully Nov 02 09:49:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168c4f7-1499-4895-91c6-d0f98de6526a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:05 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 Nov 02 09:49:05 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:06 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2" returned: 0 in 0.540s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:06 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2 Nov 02 09:49:06 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:06 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8172d10b-120c-41cf-a277-889e53dd5cc2" returned: 0 in 0.330s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Lock "cinder-quobyte-8172d10b-120c-41cf-a277-889e53dd5cc2" released by "delete_volume" :: held 0.995s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Created reservations ['ac38a9d5-3f5f-4561-86ec-be8733aa0ba5'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:06 devstack cinder-volume[86887]: WARNING cinder.quota [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1484173415 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1484173415, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:49:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Created reservations ['050b8dfb-b998-4bff-87a5-4622db68059f', '5ad1e67f-bfef-4a04-8d17-ee52df3cb45d', '94b2d583-de71-4866-b2d7-795aabba4d34', '0d590882-042a-4af5-af10-00b5ee1d5564'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:07 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:49:07 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:07 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.351s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:07 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:49:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-096ec3dd-2558-47bb-a7f9-dce5f8e02f90 tempest-GroupSnapshotsTest-173869550 None] Delete group completed successfully. Nov 02 09:49:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:49:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=41,cinder:SELECT=26,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Flow 'volume_create_manager' (8301e848-febc-45f1-88c9-713f23c8fd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e8d224-3450-4573-8032-bc23327abeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e8d224-3450-4573-8032-bc23327abeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1385199695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdfddd4-1647-4b92-ac8f-90605d2793f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416edff0bf034955aee0b2e3cef29b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:41Z,use_quota=True,user_id='625420531e1d47cbbb1f4f2c31608e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77fa6ff-0cf5-407f-b38b-2a1818e69e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77fa6ff-0cf5-407f-b38b-2a1818e69e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d936154-8d09-4869-8ea7-4996e87690b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d936154-8d09-4869-8ea7-4996e87690b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdfddd4-1647-4b92-ac8f-90605d2793f3', 'volume_name': 'volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941878f3-7cc8-423b-a392-5089b6d6a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941878f3-7cc8-423b-a392-5089b6d6a557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175489a4-d453-4600-86c3-c93d318ca061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:41 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Volume 5bdfddd4-1647-4b92-ac8f-90605d2793f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3', 'volume_size': 1} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1385199695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdfddd4-1647-4b92-ac8f-90605d2793f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416edff0bf034955aee0b2e3cef29b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:41Z,use_quota=True,user_id='625420531e1d47cbbb1f4f2c31608e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Creating volume 5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:49:41 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:49:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:41 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 1073741824 Nov 02 09:49:41 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:42 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 1073741824" returned: 0 in 0.726s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:42 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:49:42 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:42 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.343s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175489a4-d453-4600-86c3-c93d318ca061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9a4a1e-713d-4083-9f50-35659a853d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:42 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Volume volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 (5bdfddd4-1647-4b92-ac8f-90605d2793f3): created successfully Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9a4a1e-713d-4083-9f50-35659a853d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:42 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Flow 'volume_create_manager' (8301e848-febc-45f1-88c9-713f23c8fd42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:42 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c0764f1f-42be-4d26-82b2-24b9885c5bb9 tempest-TestStampPattern-225850282 None] Created volume successfully. Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Flow 'volume_create_manager' (8bacd8b7-bca3-4f34-8219-aa33bb6cd5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca6f956-0325-4cda-914e-ce8c3d9553eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bca6f956-0325-4cda-914e-ce8c3d9553eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-954065910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4df97-10e9-49c0-9f11-6359993421a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d4d9cabba4597a9b7e51ec9e1b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:43Z,use_quota=True,user_id='b4a75cb5bc2d427ebe9bff91c3306ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61eac04-db21-4b49-969f-6e3405e338c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61eac04-db21-4b49-969f-6e3405e338c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dfd6ad-edd3-4e10-9a63-12d38fba4d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dfd6ad-edd3-4e10-9a63-12d38fba4d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e4df97-10e9-49c0-9f11-6359993421a6', 'volume_name': 'volume-27e4df97-10e9-49c0-9f11-6359993421a6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3c860-cff9-4151-a96e-dc2104bd36f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3c860-cff9-4151-a96e-dc2104bd36f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8559a27-3ede-452a-bb96-e5cb4230cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:43 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume 27e4df97-10e9-49c0-9f11-6359993421a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e4df97-10e9-49c0-9f11-6359993421a6', 'volume_size': 1} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-954065910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e4df97-10e9-49c0-9f11-6359993421a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d4d9cabba4597a9b7e51ec9e1b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:43Z,use_quota=True,user_id='b4a75cb5bc2d427ebe9bff91c3306ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Creating volume 27e4df97-10e9-49c0-9f11-6359993421a6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:49:43 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:49:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:43 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 1073741824 Nov 02 09:49:43 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:44 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 1073741824" returned: 0 in 0.762s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:44 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 Nov 02 09:49:44 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:44 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8559a27-3ede-452a-bb96-e5cb4230cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e4df97-10e9-49c0-9f11-6359993421a6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626de31f-4e90-4b30-8d94-56a8e9bce4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:44 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume volume-27e4df97-10e9-49c0-9f11-6359993421a6 (27e4df97-10e9-49c0-9f11-6359993421a6): created successfully Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626de31f-4e90-4b30-8d94-56a8e9bce4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Flow 'volume_create_manager' (8bacd8b7-bca3-4f34-8219-aa33bb6cd5d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ad872132-3f16-456a-8121-dc984578cb12 tempest-VolumeQuotasAdminTestJSON-506619177 None] Created volume successfully. Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "cinder-27e4df97-10e9-49c0-9f11-6359993421a6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "cinder-27e4df97-10e9-49c0-9f11-6359993421a6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "cinder-quobyte-27e4df97-10e9-49c0-9f11-6359993421a6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "cinder-quobyte-27e4df97-10e9-49c0-9f11-6359993421a6" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ed1106-3973-4236-a7f2-79ba4bd1dba9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:46 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 Nov 02 09:49:46 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:46 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6" returned: 0 in 0.479s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:46 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6 Nov 02 09:49:46 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:46 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-27e4df97-10e9-49c0-9f11-6359993421a6" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "cinder-quobyte-27e4df97-10e9-49c0-9f11-6359993421a6" released by "delete_volume" :: held 0.816s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Created reservations ['ac2d1557-63ef-4a91-a4c3-04f8a40dd1a3', '3f007f10-410d-49a2-b796-3675728bdaf2', '0f7e61ec-3a52-4fbe-85c7-2df8dfb0ecc6', 'ed50e4f4-5eb0-4124-8cf2-378c15dfba32'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:47 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:49:47 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:47 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:49:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Deleted volume successfully. Nov 02 09:49:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9c15abfe-3c87-4997-8a19-e77d04149950 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "cinder-27e4df97-10e9-49c0-9f11-6359993421a6-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:49:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Flow 'volume_create_manager' (e37bfe33-b801-46b6-8ea9-5713748797f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810f34c-c64c-43fa-a704-c9e4a4d1b3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d810f34c-c64c-43fa-a704-c9e4a4d1b3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1728389671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b70ca88-bcd9-48ca-96b9-0f9faff5b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d4d9cabba4597a9b7e51ec9e1b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:49Z,use_quota=True,user_id='b4a75cb5bc2d427ebe9bff91c3306ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ecff8f-f8ef-455d-aa98-2eb18dd59312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ecff8f-f8ef-455d-aa98-2eb18dd59312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53363ed3-b049-4bf1-b321-545f7a587672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53363ed3-b049-4bf1-b321-545f7a587672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b70ca88-bcd9-48ca-96b9-0f9faff5b419', 'volume_name': 'volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407af48b-c87b-476a-acd6-b77ea1e1e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407af48b-c87b-476a-acd6-b77ea1e1e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aa4512-0d0a-4ea8-af93-d52ea654123f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:49 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume 4b70ca88-bcd9-48ca-96b9-0f9faff5b419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419', 'volume_size': 1} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1728389671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b70ca88-bcd9-48ca-96b9-0f9faff5b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d4d9cabba4597a9b7e51ec9e1b574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:49Z,use_quota=True,user_id='b4a75cb5bc2d427ebe9bff91c3306ef5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Creating volume 4b70ca88-bcd9-48ca-96b9-0f9faff5b419 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:49:49 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:49 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 1073741824 Nov 02 09:49:49 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:49 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 1073741824" returned: 0 in 0.826s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:50 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 Nov 02 09:49:50 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:50 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" returned: 0 in 0.398s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aa4512-0d0a-4ea8-af93-d52ea654123f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6316b7b7-97e7-4677-a5e4-fdc2761cfb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Volume volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 (4b70ca88-bcd9-48ca-96b9-0f9faff5b419): created successfully Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6316b7b7-97e7-4677-a5e4-fdc2761cfb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Flow 'volume_create_manager' (e37bfe33-b801-46b6-8ea9-5713748797f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-be71a03b-992c-4147-af08-78e22967ef76 tempest-VolumeQuotasAdminTestJSON-506619177 None] Created volume successfully. Nov 02 09:49:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4c9ea2b3-dc5b-48bf-92ab-966e6470dbb5 tempest-VolumeQuotasAdminTestJSON-2035618881 None] Transfer volume completed successfully. Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Acquiring lock "cinder-4b70ca88-bcd9-48ca-96b9-0f9faff5b419-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "cinder-4b70ca88-bcd9-48ca-96b9-0f9faff5b419-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Acquiring lock "cinder-quobyte-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "cinder-quobyte-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d1e418-87c2-4dac-b512-6d5c54269475]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:53 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 Nov 02 09:49:53 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:54 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" returned: 0 in 0.648s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:54 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419 Nov 02 09:49:54 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:54 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "cinder-quobyte-4b70ca88-bcd9-48ca-96b9-0f9faff5b419" released by "delete_volume" :: held 1.137s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Created reservations ['8d6d3b17-3b5d-4163-b039-cade6bc11a94', 'b3979947-3d49-4ecb-b8d7-1a1cf2641702', '39231e09-2660-42de-9fad-1b733a635749', 'a3bee0df-21d1-4b81-865a-674abede279f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:54 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:49:54 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:55 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:49:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Deleted volume successfully. Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e8330595-6de6-46c0-992a-adda8793d5c0 tempest-VolumeQuotasAdminTestJSON-1282562035 None] Lock "cinder-4b70ca88-bcd9-48ca-96b9-0f9faff5b419-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Flow 'volume_create_manager' (ad890811-17c1-4365-8955-f341fdd2a8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bda030c-3c34-4f72-a1c0-bbede913d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bda030c-3c34-4f72-a1c0-bbede913d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-638182071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0c95f5-32f8-4981-8aa7-55911fe0aa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc14cd85667468bb1724790102d2a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:56Z,use_quota=True,user_id='d2365d657e434882a60ab7a1cce2ecab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e5d975-f4f8-41f9-9e06-42c5c9731a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e5d975-f4f8-41f9-9e06-42c5c9731a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8accd-f132-49af-b694-48ab3511eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a8accd-f132-49af-b694-48ab3511eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0c95f5-32f8-4981-8aa7-55911fe0aa10', 'volume_name': 'volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa84a40c-d4fd-4cb5-acc2-c084f81c22dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa84a40c-d4fd-4cb5-acc2-c084f81c22dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a25812a-b568-480b-8e4d-62b7b3a76ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Volume be0c95f5-32f8-4981-8aa7-55911fe0aa10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10', 'volume_size': 1} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-638182071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0c95f5-32f8-4981-8aa7-55911fe0aa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc14cd85667468bb1724790102d2a9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:49:56Z,use_quota=True,user_id='d2365d657e434882a60ab7a1cce2ecab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Creating volume be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:49:55 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:49:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:56 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 1073741824 Nov 02 09:49:56 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:56 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 1073741824" returned: 0 in 0.650s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:56 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:49:56 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:56 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a25812a-b568-480b-8e4d-62b7b3a76ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f83fae5-836a-4e3f-83bd-1b5a6d2e3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:49:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Volume volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 (be0c95f5-32f8-4981-8aa7-55911fe0aa10): created successfully Nov 02 09:49:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f83fae5-836a-4e3f-83bd-1b5a6d2e3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:49:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Flow 'volume_create_manager' (ad890811-17c1-4365-8955-f341fdd2a8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:49:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b839224e-ec3d-4857-8d1b-abc649068998 tempest-TestImageHashVerification-188349734 None] Created volume successfully. Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:58 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:49:58 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:58 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.344s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:49:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a349a4-0f80-4dc0-99a3-e57236bf2d68]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:49:59 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:49:59 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:49:59 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.505s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ce84a-315e-4a3e-ad79-c361feddd592]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:49:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:00 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:50:00 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:00 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.443s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 /opt/stack/data/cinder/conversion/be0c95f5-32f8-4981-8aa7-55911fe0aa10.temp_image.84fe6f60-65cc-4832-9b7f-9def7a38eb2awhpqmguk.img {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:00 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 /opt/stack/data/cinder/conversion/be0c95f5-32f8-4981-8aa7-55911fe0aa10.temp_image.84fe6f60-65cc-4832-9b7f-9def7a38eb2awhpqmguk.img Nov 02 09:50:00 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:07 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=16,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:50:07 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 /opt/stack/data/cinder/conversion/be0c95f5-32f8-4981-8aa7-55911fe0aa10.temp_image.84fe6f60-65cc-4832-9b7f-9def7a38eb2awhpqmguk.img" returned: 0 in 7.393s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619b60a-09d9-4123-9f8c-c9e63e5f46d3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:07 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:50:07 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Flow 'volume_create_manager' (30880f9e-1ee6-4cc8-81a5-dff53dd4dd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a66e5e-164f-4a80-a493-f9e6299188e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a66e5e-164f-4a80-a493-f9e6299188e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1829574005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46984a44-3692-4f88-99d8-f0f6b094048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbc05b5fd7434287a89445d1de425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:08Z,use_quota=True,user_id='cd8b3d67520b4e739209e01fca3b4744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af782e6f-86b2-4818-9fa2-317b8c29c669),volume_type_id=af782e6f-86b2-4818-9fa2-317b8c29c669)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8464eb-0d37-4706-b227-c2b11bdf9857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8464eb-0d37-4706-b227-c2b11bdf9857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7d3da7-e34e-4fc7-b9ac-cf0cbdf4389e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7d3da7-e34e-4fc7-b9ac-cf0cbdf4389e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46984a44-3692-4f88-99d8-f0f6b094048a', 'volume_name': 'volume-46984a44-3692-4f88-99d8-f0f6b094048a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4763e8e4-43d1-4bdd-969c-903a087603e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4763e8e4-43d1-4bdd-969c-903a087603e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcac70b-ac02-4291-bbec-6f25602f75c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Volume 46984a44-3692-4f88-99d8-f0f6b094048a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46984a44-3692-4f88-99d8-f0f6b094048a', 'volume_size': 1} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:08 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.572s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/conversion/be0c95f5-32f8-4981-8aa7-55911fe0aa10.temp_image.84fe6f60-65cc-4832-9b7f-9def7a38eb2awhpqmguk.img {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:50:08 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Converted 1024.00 MB image at 138.48 MB/s Nov 02 09:50:08 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] 84fe6f60-65cc-4832-9b7f-9def7a38eb2a was raw, no need to convert to raw {{(pid=86887) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 09:50:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-831d1568-594d-414a-9b76-417b5cca0802 req-6826329c-5875-4c8f-80f7-d7082f9578f5 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=4 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.306s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Uploaded volume to glance image-id: 84fe6f60-65cc-4832-9b7f-9def7a38eb2a. {{(pid=86887) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.582s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1829574005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46984a44-3692-4f88-99d8-f0f6b094048a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99bbc05b5fd7434287a89445d1de425c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:08Z,use_quota=True,user_id='cd8b3d67520b4e739209e01fca3b4744',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af782e6f-86b2-4818-9fa2-317b8c29c669),volume_type_id=af782e6f-86b2-4818-9fa2-317b8c29c669)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Creating volume 46984a44-3692-4f88-99d8-f0f6b094048a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:50:27 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:50:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:27 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a 1073741824 Nov 02 09:50:27 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-740b9891-e555-4047-8cda-edeb8aaf2517 tempest-TestImageHashVerification-188349734 None] Copy volume to image completed successfully. Nov 02 09:50:28 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a 1073741824" returned: 0 in 0.459s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:28 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a Nov 02 09:50:28 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:28 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a" returned: 0 in 0.257s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-831d1568-594d-414a-9b76-417b5cca0802 req-6826329c-5875-4c8f-80f7-d7082f9578f5 tempest-TestStampPattern-225850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.264s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-831d1568-594d-414a-9b76-417b5cca0802 req-6826329c-5875-4c8f-80f7-d7082f9578f5 tempest-TestStampPattern-225850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcac70b-ac02-4291-bbec-6f25602f75c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46984a44-3692-4f88-99d8-f0f6b094048a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e2fb0b-be8f-4ba7-a376-ef2709c95c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:28 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Volume volume-46984a44-3692-4f88-99d8-f0f6b094048a (46984a44-3692-4f88-99d8-f0f6b094048a): created successfully Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e2fb0b-be8f-4ba7-a376-ef2709c95c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Flow 'volume_create_manager' (30880f9e-1ee6-4cc8-81a5-dff53dd4dd4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8e62fed5-84a8-478f-8976-cf728a741c04 tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Created volume successfully. Nov 02 09:50:28 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-831d1568-594d-414a-9b76-417b5cca0802 req-6826329c-5875-4c8f-80f7-d7082f9578f5 tempest-TestStampPattern-225850282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f36c04a3-a0c2-4d2b-ba2f-62cc4fc9a272', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:50:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-831d1568-594d-414a-9b76-417b5cca0802 req-6826329c-5875-4c8f-80f7-d7082f9578f5 tempest-TestStampPattern-225850282 None] attachment_update completed successfully. Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Acquiring lock "cinder-be0c95f5-32f8-4981-8aa7-55911fe0aa10-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "cinder-be0c95f5-32f8-4981-8aa7-55911fe0aa10-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Acquiring lock "cinder-quobyte-be0c95f5-32f8-4981-8aa7-55911fe0aa10" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "cinder-quobyte-be0c95f5-32f8-4981-8aa7-55911fe0aa10" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca7017-24b1-4744-9780-c92740ee3d54]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:29 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:50:29 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:29 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:29 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10 Nov 02 09:50:29 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:30 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:50:30 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:30 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-be0c95f5-32f8-4981-8aa7-55911fe0aa10" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "cinder-quobyte-be0c95f5-32f8-4981-8aa7-55911fe0aa10" released by "delete_volume" :: held 0.825s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Created reservations ['0ea99fae-8293-43bc-8d64-d6f1c71c86fe', '930247a0-0662-4d5e-862a-40927f3679dc', '8a3bce10-155a-428e-8cab-b0dc05da5387', '2abb6ae3-d67d-4dfa-be91-61a4a699239a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:50:30 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.319s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:50:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c4b0ee99-0f5e-4f00-9063-3af70a2c691a tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Retype volume completed successfully. Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:30 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:50:30 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:30 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.300s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:50:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Deleted volume successfully. Nov 02 09:50:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ea7eeed8-6ec5-4742-bcb7-5a9813ee398a tempest-TestImageHashVerification-188349734 None] Lock "cinder-be0c95f5-32f8-4981-8aa7-55911fe0aa10-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "cinder-46984a44-3692-4f88-99d8-f0f6b094048a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "cinder-46984a44-3692-4f88-99d8-f0f6b094048a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "cinder-quobyte-46984a44-3692-4f88-99d8-f0f6b094048a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "cinder-quobyte-46984a44-3692-4f88-99d8-f0f6b094048a" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027ea84-31ce-4299-a894-c675d5221a63]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:31 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a Nov 02 09:50:31 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:31 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:31 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a Nov 02 09:50:31 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:32 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-46984a44-3692-4f88-99d8-f0f6b094048a" returned: 0 in 0.274s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "cinder-quobyte-46984a44-3692-4f88-99d8-f0f6b094048a" released by "delete_volume" :: held 0.808s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:32 devstack cinder-volume[86887]: WARNING cinder.quota [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:50:32 devstack cinder-volume[86887]: WARNING cinder.quota [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Created reservations ['476e5027-6d48-4e71-bf28-38ddd693ac41', 'd676a063-8784-4e9f-aa26-d62a2573a4bf', '4fbf39ca-93f6-44ed-8cb2-6fb760327c7e', '4194deeb-50c7-40d9-9606-3392ef6feed8'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:32 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:50:32 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:32 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:50:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Deleted volume successfully. Nov 02 09:50:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f45c5088-2561-41ad-845c-336c3480b34d tempest-VolumeRetypeWithoutMigrationTest-1038587856 None] Lock "cinder-46984a44-3692-4f88-99d8-f0f6b094048a-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-30ea3a98-efde-4d87-9a67-ba14eefe34e0 req-958f3866-2b83-47a3-ba4e-3fa7f87e2f31 tempest-TestStampPattern-225850282 None] Terminate volume connection completed successfully. Nov 02 09:50:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-30ea3a98-efde-4d87-9a67-ba14eefe34e0 req-958f3866-2b83-47a3-ba4e-3fa7f87e2f31 tempest-TestStampPattern-225850282 None] Deleting attachment f36c04a3-a0c2-4d2b-ba2f-62cc4fc9a272. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:50:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Creating offline snapshot 5be5c99b-84a4-4f98-b1cd-de19515c3176 of volume 5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:50:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed72393-6d82-4ce0-9cfa-afb29391b394]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:35 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:50:35 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:36 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.549s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:36 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 1G Nov 02 09:50:36 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:36 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 1G" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:36 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:50:36 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:37 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:37 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 is being set with open permissions: ugo+rw Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:37 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:50:37 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:37 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.290s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:37 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info Nov 02 09:50:37 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:37 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:37 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info is being set with open permissions: ugo+rw Nov 02 09:50:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:37 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info Nov 02 09:50:37 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:38 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.info" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8fddf469-a482-4196-88af-fba545db9903 tempest-TestStampPattern-225850282 None] Create snapshot completed successfully Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Flow 'volume_create_manager' (c2ed07b4-006b-429e-a1b7-06d2b73c46b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be9c9-b512-439d-a0ba-a0786ea1b75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be9c9-b512-439d-a0ba-a0786ea1b75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2062438728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f22d4e3-c807-44c7-a9f3-eab00922fee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1484d15d5ffd4a7fa6b5342803758872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:40Z,use_quota=True,user_id='0f639c63b99b459490b34873c4e674bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd20e5d-15b1-42c6-8c0f-2dd7b118f8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfd20e5d-15b1-42c6-8c0f-2dd7b118f8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc991a7-053b-41b8-8fb7-667d94a96a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc991a7-053b-41b8-8fb7-667d94a96a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f22d4e3-c807-44c7-a9f3-eab00922fee9', 'volume_name': 'volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680952a9-9e05-411a-9703-6fe0df0af4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680952a9-9e05-411a-9703-6fe0df0af4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d40921-e723-43cc-8c5c-166f2ea0a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Volume 7f22d4e3-c807-44c7-a9f3-eab00922fee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9', 'volume_size': 1} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2062438728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f22d4e3-c807-44c7-a9f3-eab00922fee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1484d15d5ffd4a7fa6b5342803758872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:40Z,use_quota=True,user_id='0f639c63b99b459490b34873c4e674bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Creating volume 7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:50:40 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:50:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:40 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 1073741824 Nov 02 09:50:40 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:41 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 1073741824" returned: 0 in 0.710s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:41 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 Nov 02 09:50:41 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:41 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9" returned: 0 in 0.282s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5d40921-e723-43cc-8c5c-166f2ea0a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8503d8d8-6f4d-4529-a09e-9bb6d94e1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:41 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Volume volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 (7f22d4e3-c807-44c7-a9f3-eab00922fee9): created successfully Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8503d8d8-6f4d-4529-a09e-9bb6d94e1301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Flow 'volume_create_manager' (c2ed07b4-006b-429e-a1b7-06d2b73c46b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1cf90bc9-4403-4300-8842-1082a980b317 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Created volume successfully. Nov 02 09:50:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Creating offline snapshot 69b7075b-4ce4-40d1-8c18-7bc135d5a81f of volume 7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:50:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3ce62-3df3-41b7-9875-a28476f3ca26]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:42 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 Nov 02 09:50:42 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:43 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9" returned: 0 in 0.457s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:43 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f 1G Nov 02 09:50:43 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:43 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f 1G" returned: 0 in 0.532s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:43 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f Nov 02 09:50:43 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:44 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f" returned: 0 in 0.366s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f is being set with open permissions: ugo+rw Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:44 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f Nov 02 09:50:44 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:44 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f" returned: 0 in 0.270s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:44 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info Nov 02 09:50:44 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:44 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info" returned: 0 in 0.328s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info is being set with open permissions: ugo+rw Nov 02 09:50:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:44 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info Nov 02 09:50:44 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:45 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.info" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bd3baa35-5a49-4dfc-8224-1ea053f507a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Create snapshot completed successfully Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "cinder-69b7075b-4ce4-40d1-8c18-7bc135d5a81f-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-69b7075b-4ce4-40d1-8c18-7bc135d5a81f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "cinder-quobyte-69b7075b-4ce4-40d1-8c18-7bc135d5a81f" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-69b7075b-4ce4-40d1-8c18-7bc135d5a81f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Deleting offline snapshot 69b7075b-4ce4-40d1-8c18-7bc135d5a81f of volume 7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] snapshot_file for this snap is: volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e5631f-9281-4932-bda8-563b2f0df478]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:46 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f Nov 02 09:50:46 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:46 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f" returned: 0 in 0.424s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5f147-3edd-40f3-b3fb-b60c44528177]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:47 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 Nov 02 09:50:47 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:50:47 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9" returned: 0 in 0.481s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:47 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f Nov 02 09:50:47 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Flow 'volume_create_manager' (c10cb80f-488c-4fdd-aafa-b82de1c3c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82ce4be-53b0-4d8d-b83b-5624bb538b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82ce4be-53b0-4d8d-b83b-5624bb538b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1788153957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd701f61-f7f1-48c7-8ebd-4ecb14c260a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416edff0bf034955aee0b2e3cef29b75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5be5c99b-84a4-4f98-b1cd-de19515c3176,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:47Z,use_quota=True,user_id='625420531e1d47cbbb1f4f2c31608e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb772a1-9589-406c-9cd5-d813f971e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb772a1-9589-406c-9cd5-d813f971e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559520ac-79b4-4aa6-aafe-ff7fc75e5352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559520ac-79b4-4aa6-aafe-ff7fc75e5352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd701f61-f7f1-48c7-8ebd-4ecb14c260a2', 'volume_name': 'volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2', 'volume_size': 1, 'snapshot_id': '5be5c99b-84a4-4f98-b1cd-de19515c3176'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230fbc56-8c09-40ae-983f-13f33e9f62e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230fbc56-8c09-40ae-983f-13f33e9f62e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db10e906-f841-4125-993f-eee5f20195db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Volume fd701f61-f7f1-48c7-8ebd-4ecb14c260a2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2', 'volume_size': 1, 'snapshot_id': '5be5c99b-84a4-4f98-b1cd-de19515c3176'} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Creating volume fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 from snapshot 5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] snapshot: 5be5c99b-84a4-4f98-b1cd-de19515c3176, volume: fd701f61-f7f1-48c7-8ebd-4ecb14c260a2, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a299d0-31c7-47a2-a788-62462782c437]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:47 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:50:47 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:47 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f" returned: 0 in 0.516s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:48 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f Nov 02 09:50:48 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:48 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.532s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[daab7b5d-5fe0-42c7-b01d-55f197961ca8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:48 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9.69b7075b-4ce4-40d1-8c18-7bc135d5a81f" returned: 0 in 0.412s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:48 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:50:48 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-69b7075b-4ce4-40d1-8c18-7bc135d5a81f" released by "_delete_snapshot" :: held 2.002s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" released by "delete_snapshot" :: held 2.036s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Created reservations ['9b2d9c90-c63e-41e0-92fd-b056f6e6acc8', 'dda90687-7e79-4afd-9f69-5d9f34d31a67', '2ecf4806-4561-4bab-8749-39da97c4914c', '4bee160f-8f3e-4036-86df-b01d27d63b5c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:50:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Delete snapshot completed successfully. Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36e87625-608a-42c2-a5a1-0f8527291b4e tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-69b7075b-4ce4-40d1-8c18-7bc135d5a81f-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:48 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.568s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:50:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:48 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 Nov 02 09:50:48 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "cinder-7f22d4e3-c807-44c7-a9f3-eab00922fee9-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-7f22d4e3-c807-44c7-a9f3-eab00922fee9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" acquired by "delete_volume" :: waited 0.058s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad2c49b-336c-48eb-83cd-ace283289b20]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:50 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 Nov 02 09:50:50 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Flow 'volume_create_manager' (ad850de8-3205-4000-a4ba-a1d6ba7324c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3061263-4c6a-4ba9-b438-e78d49275a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3061263-4c6a-4ba9-b438-e78d49275a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e9fc84-9f45-466d-9d43-22ae89a165ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2852461a3e349819a22ad320df49733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:50Z,use_quota=True,user_id='581abd1f78494965b5589903ca5ee24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ac5ea44-9113-461a-bce8-457a75e4e77f),volume_type_id=2ac5ea44-9113-461a-bce8-457a75e4e77f)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc7930a-6335-413c-91a5-8315a613c18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edc7930a-6335-413c-91a5-8315a613c18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768fea0c-911c-44a5-a7b8-fe26644cba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:50:50 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9" returned: 0 in 0.630s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:50 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9 Nov 02 09:50:50 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768fea0c-911c-44a5-a7b8-fe26644cba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76e9fc84-9f45-466d-9d43-22ae89a165ff', 'volume_name': 'volume-76e9fc84-9f45-466d-9d43-22ae89a165ff', 'volume_size': 1, 'image_id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0deef7fb136dd28ad48dd76b7148296', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2852461a3e349819a22ad320df49733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7e31eeb8c9c62d4253edc279997434e7ffb726e2e1a250624ea6c86e288f8c1d86461225abdae6da7b2e5b9c2d4ff3bbf07cfd8ea7618fbc8e9b4dd9b853c34', 'id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'created_at': datetime.datetime(2026, 11, 2, 8, 50, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f0a7b27-482e-4335-b584-f9603e1330d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6b8656-d2f5-4793-b6c8-3ed3d3454292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6b8656-d2f5-4793-b6c8-3ed3d3454292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabf3809-b04d-4394-b896-b924440be924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:50:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Volume 76e9fc84-9f45-466d-9d43-22ae89a165ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76e9fc84-9f45-466d-9d43-22ae89a165ff', 'volume_size': 1, 'image_id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0deef7fb136dd28ad48dd76b7148296', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2852461a3e349819a22ad320df49733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7e31eeb8c9c62d4253edc279997434e7ffb726e2e1a250624ea6c86e288f8c1d86461225abdae6da7b2e5b9c2d4ff3bbf07cfd8ea7618fbc8e9b4dd9b853c34', 'id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'created_at': datetime.datetime(2026, 11, 2, 8, 50, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f0a7b27-482e-4335-b584-f9603e1330d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Trying to clone 76e9fc84-9f45-466d-9d43-22ae89a165ff from image 2f0a7b27-482e-4335-b584-f9603e1330d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:50:51 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7f22d4e3-c807-44c7-a9f3-eab00922fee9" returned: 0 in 0.524s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-quobyte-7f22d4e3-c807-44c7-a9f3-eab00922fee9" released by "delete_volume" :: held 1.325s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Created reservations ['41e788a8-b9f3-4509-88d7-ac7ee469ff4e', 'c703df36-27ff-4f81-a08e-cbe92ce40068', '9abdf0f9-2cce-44c7-8a8f-1f1929edab9f', 'acbbf117-d851-45cb-bf4d-d0618f45f5b7'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:50:51 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Image download 0.00 MB at 0.00 MB/s Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:51 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:50:51 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa3298-023b-44d7-9c12-2840fd6eea16]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:52 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:50:52 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:52 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.687s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:52 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:50:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Deleted volume successfully. Nov 02 09:50:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d9de757d-b202-44be-ad4c-51f975529e79 tempest-VolumeSnapshotQuotasNegativeTestJSON-996800138 None] Lock "cinder-7f22d4e3-c807-44c7-a9f3-eab00922fee9-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:50:52 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:52 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:50:52 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:53 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 1 in 0.684s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:50:53 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Temporary image 2f0a7b27-482e-4335-b584-f9603e1330d7 is fetched for user 581abd1f78494965b5589903ca5ee24f. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:50:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[996dfa6c-39bf-4647-914a-e31929246a6f]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:50:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:53 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:50:53 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:54 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 0 in 0.909s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:50:54 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:50:54 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:50:55 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Nov 02 09:50:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 1 in 0.697s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:50:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:50:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:50:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:50:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:50:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" returned: 0 in 11.123s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3, size 1024.00 MB, duration 11.12 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:51:00 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Converted 1024.00 MB image at 92.06 MB/s Nov 02 09:51:00 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 is being set with open permissions: ugo+rw Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:00 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 Nov 02 09:51:00 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:00 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" returned: 0 in 0.506s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" released by "_copy_volume_from_snapshot" :: held 12.873s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" released by "_create_volume_from_snapshot" :: held 12.979s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.448s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e9fc84-9f45-466d-9d43-22ae89a165ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2852461a3e349819a22ad320df49733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:50:50Z,use_quota=True,user_id='581abd1f78494965b5589903ca5ee24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ac5ea44-9113-461a-bce8-457a75e4e77f),volume_type_id=2ac5ea44-9113-461a-bce8-457a75e4e77f)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Creating volume 76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:00 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:00 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1073741824 Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db10e906-f841-4125-993f-eee5f20195db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2', 'volume_size': 1, 'snapshot_id': '5be5c99b-84a4-4f98-b1cd-de19515c3176'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:00 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048160d0-8c01-4fbd-a0bd-f101da001599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:00 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Volume volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 (fd701f61-f7f1-48c7-8ebd-4ecb14c260a2): created successfully Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (048160d0-8c01-4fbd-a0bd-f101da001599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Flow 'volume_create_manager' (c10cb80f-488c-4fdd-aafa-b82de1c3c210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d8072545-7c77-43e5-ad21-690f27943356 tempest-TestStampPattern-225850282 None] Created volume successfully. Nov 02 09:51:01 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1073741824" returned: 0 in 0.703s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:01 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff Nov 02 09:51:01 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:01 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:01 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Attempting download of 2f0a7b27-482e-4335-b584-f9603e1330d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}])) to volume 76e9fc84-9f45-466d-9d43-22ae89a165ff. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[89582af6-5b07-45e0-b5ab-6cc2ed96c976]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:02 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit Nov 02 09:51:02 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:02 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit" returned: 0 in 0.381s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:02 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit Nov 02 09:51:02 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:02 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit" returned: 1 in 0.381s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f0a7b27-482e-4335-b584-f9603e1330d7_xh_s2nit' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24831c-9b87-4621-bf24-61552ab9b2db]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:02 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:51:02 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:03 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:03 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD Nov 02 09:51:03 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:03 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD" returned: 1 in 0.550s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] 2f0a7b27-482e-4335-b584-f9603e1330d7 was raw, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:51:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:03 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff Nov 02 09:51:03 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:04 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff" returned: 0 in 0.731s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f0a7b27-482e-4335-b584-f9603e1330d7_7b4w__dodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:51:04 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:04 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1G Nov 02 09:51:04 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:04 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff 1G" returned: 0 in 0.451s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Downloaded image 2f0a7b27-482e-4335-b584-f9603e1330d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}])) to volume 76e9fc84-9f45-466d-9d43-22ae89a165ff successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Temporary image 2f0a7b27-482e-4335-b584-f9603e1330d7 for user 581abd1f78494965b5589903ca5ee24f is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Marking volume 76e9fc84-9f45-466d-9d43-22ae89a165ff as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Copying metadata from image 2f0a7b27-482e-4335-b584-f9603e1330d7 to 76e9fc84-9f45-466d-9d43-22ae89a165ff. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:51:04 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Creating volume glance metadata for volume 76e9fc84-9f45-466d-9d43-22ae89a165ff backed by image 2f0a7b27-482e-4335-b584-f9603e1330d7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd0deef7fb136dd28ad48dd76b7148296', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabf3809-b04d-4394-b896-b924440be924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e9fc84-9f45-466d-9d43-22ae89a165ff', 'volume_size': 1, 'image_id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f0a7b27-482e-4335-b584-f9603e1330d7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd0deef7fb136dd28ad48dd76b7148296', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2852461a3e349819a22ad320df49733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7e31eeb8c9c62d4253edc279997434e7ffb726e2e1a250624ea6c86e288f8c1d86461225abdae6da7b2e5b9c2d4ff3bbf07cfd8ea7618fbc8e9b4dd9b853c34', 'id': '2f0a7b27-482e-4335-b584-f9603e1330d7', 'created_at': datetime.datetime(2026, 11, 2, 8, 50, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 50, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f0a7b27-482e-4335-b584-f9603e1330d7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77312741-a516-4ac7-af8b-137924b15722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Volume volume-76e9fc84-9f45-466d-9d43-22ae89a165ff (76e9fc84-9f45-466d-9d43-22ae89a165ff): created successfully Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77312741-a516-4ac7-af8b-137924b15722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Flow 'volume_create_manager' (ad850de8-3205-4000-a4ba-a1d6ba7324c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bb5adad4-6105-4be3-9c6e-97da5768dcb8 tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Created volume successfully. Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Acquiring lock "cinder-76e9fc84-9f45-466d-9d43-22ae89a165ff-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "cinder-76e9fc84-9f45-466d-9d43-22ae89a165ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Acquiring lock "cinder-quobyte-76e9fc84-9f45-466d-9d43-22ae89a165ff" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "cinder-quobyte-76e9fc84-9f45-466d-9d43-22ae89a165ff" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77bbc2-8592-476e-a327-b9f38085de4a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:05 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff Nov 02 09:51:05 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:06 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff" returned: 0 in 0.460s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:06 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff Nov 02 09:51:06 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:06 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-76e9fc84-9f45-466d-9d43-22ae89a165ff" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "cinder-quobyte-76e9fc84-9f45-466d-9d43-22ae89a165ff" released by "delete_volume" :: held 0.853s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:06 devstack cinder-volume[86887]: WARNING cinder.quota [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:51:06 devstack cinder-volume[86887]: WARNING cinder.quota [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Created reservations ['3ad58b63-8b24-4189-8ded-25fe35429a00', '8522f525-8175-4f1f-9e21-e9596e93fe62', '71f38b67-8886-4add-9694-437992cad4b4', 'b82436a5-71a7-4801-8341-1fc4b660890c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:06 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:06 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:07 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.530s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:07 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Deleted volume successfully. Nov 02 09:51:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-775fcf07-81ca-414d-8cc8-558f530e86bf tempest-VolumeAndVolumeTypeFromImageTest-734437968 None] Lock "cinder-76e9fc84-9f45-466d-9d43-22ae89a165ff-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (36d66a4c-0acf-4825-88f5-324ad5811d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e10866-254a-4cbe-860b-af0477fb281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e10866-254a-4cbe-860b-af0477fb281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363423926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21857eb9-bc8c-49e2-b420-ec6560632f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:14Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e5972-d1ed-4acc-b22e-f9d38cdb694b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e5972-d1ed-4acc-b22e-f9d38cdb694b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813e2ff6-667a-41c3-a481-bd7da16640b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813e2ff6-667a-41c3-a481-bd7da16640b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21857eb9-bc8c-49e2-b420-ec6560632f26', 'volume_name': 'volume-21857eb9-bc8c-49e2-b420-ec6560632f26', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb52778-83b1-4d31-8517-ea47aa393203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb52778-83b1-4d31-8517-ea47aa393203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce30f90-0f8c-4582-9643-ef35ea5bb5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:14 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume 21857eb9-bc8c-49e2-b420-ec6560632f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21857eb9-bc8c-49e2-b420-ec6560632f26', 'volume_size': 1} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363423926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21857eb9-bc8c-49e2-b420-ec6560632f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:14Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume 21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:14 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:14 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 1073741824 Nov 02 09:51:14 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:14 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 1073741824" returned: 0 in 0.558s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:14 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 Nov 02 09:51:14 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:15 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce30f90-0f8c-4582-9643-ef35ea5bb5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21857eb9-bc8c-49e2-b420-ec6560632f26', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5d392e-ddc2-4f7a-8e31-564237bd4c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:15 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-21857eb9-bc8c-49e2-b420-ec6560632f26 (21857eb9-bc8c-49e2-b420-ec6560632f26): created successfully Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5d392e-ddc2-4f7a-8e31-564237bd4c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (36d66a4c-0acf-4825-88f5-324ad5811d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a9deaddf-1706-4c27-9cbd-f3378bcf6526 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating offline snapshot 8a3bd953-9a72-4135-a3e9-6692d0a96a2b of volume 21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b24e8-ce05-4ca1-ac51-24620ad92a26]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:16 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 Nov 02 09:51:16 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:16 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:16 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b 1G Nov 02 09:51:16 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:17 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b 1G" returned: 0 in 0.539s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21857eb9-bc8c-49e2-b420-ec6560632f26 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:17 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21857eb9-bc8c-49e2-b420-ec6560632f26 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b Nov 02 09:51:17 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:17 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21857eb9-bc8c-49e2-b420-ec6560632f26 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b" returned: 0 in 0.305s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:17 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b is being set with open permissions: ugo+rw Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:17 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b Nov 02 09:51:17 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:17 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:17 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info Nov 02 09:51:17 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:18 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:18 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info is being set with open permissions: ugo+rw Nov 02 09:51:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:18 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info Nov 02 09:51:18 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:18 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.info" returned: 0 in 0.331s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-784cd2ed-f258-4a55-8e8f-6299e20bbe67 tempest-CreateVolumesFromSnapshotTest-851287574 None] Create snapshot completed successfully Nov 02 09:51:19 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (b8611019-cd2a-451b-8532-06ffe95e467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5caab14-2839-4014-be7c-490592fc84ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5caab14-2839-4014-be7c-490592fc84ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606132965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771d636f-f3e7-4e0e-a2df-d06b56b93be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:20Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346b01a7-a3e5-40d5-9a17-2ebf0ddf4133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346b01a7-a3e5-40d5-9a17-2ebf0ddf4133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a332672-b66b-49cf-9a90-52368dc02a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a332672-b66b-49cf-9a90-52368dc02a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771d636f-f3e7-4e0e-a2df-d06b56b93be7', 'volume_name': 'volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c885e3-e703-44fb-a385-5b445d9853a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c885e3-e703-44fb-a385-5b445d9853a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbda542-9f9b-468d-a6e6-537068492890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume 771d636f-f3e7-4e0e-a2df-d06b56b93be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7', 'volume_size': 1} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606132965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771d636f-f3e7-4e0e-a2df-d06b56b93be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:20Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume 771d636f-f3e7-4e0e-a2df-d06b56b93be7 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:20 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:20 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 1073741824 Nov 02 09:51:20 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (a624cc36-1401-40b9-8859-9776f12cfd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebb2569-d78f-4542-b773-40055b0e06d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebb2569-d78f-4542-b773-40055b0e06d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745747325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4494376-3834-4b1d-8e98-ab202f582520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:20Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6494f10-d6fe-467b-89b2-d87413aca2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6494f10-d6fe-467b-89b2-d87413aca2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502d1b7d-94f6-4585-ac99-3a2169e9139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502d1b7d-94f6-4585-ac99-3a2169e9139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4494376-3834-4b1d-8e98-ab202f582520', 'volume_name': 'volume-e4494376-3834-4b1d-8e98-ab202f582520', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6f5040-6cee-4ce0-8a4d-1481707fe077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de6f5040-6cee-4ce0-8a4d-1481707fe077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1756ac-b609-46ac-aa95-16d10d516faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume e4494376-3834-4b1d-8e98-ab202f582520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4494376-3834-4b1d-8e98-ab202f582520', 'volume_size': 1} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:20 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 1073741824" returned: 0 in 0.716s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:20 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 Nov 02 09:51:20 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (e52333b9-243b-463e-ba57-bd3f55647e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7900fe4-69e6-4d6c-8994-fcfbb0528964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7900fe4-69e6-4d6c-8994-fcfbb0528964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480391711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04cd292-27f6-4038-adcd-25220e6bff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:21Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c727c9-78ab-4b5b-b1cb-4e2d9aa045c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c727c9-78ab-4b5b-b1cb-4e2d9aa045c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baa20b0-dd7d-46d4-992b-a789dbdff497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4baa20b0-dd7d-46d4-992b-a789dbdff497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04cd292-27f6-4038-adcd-25220e6bff53', 'volume_name': 'volume-e04cd292-27f6-4038-adcd-25220e6bff53', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bf994e-3590-47ed-82b5-8c9ea179f269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bf994e-3590-47ed-82b5-8c9ea179f269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4626dde-ce27-423a-8fed-436ad8f75731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume e04cd292-27f6-4038-adcd-25220e6bff53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04cd292-27f6-4038-adcd-25220e6bff53', 'volume_size': 1} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7" returned: 0 in 0.448s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.528s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1745747325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4494376-3834-4b1d-8e98-ab202f582520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:20Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume e4494376-3834-4b1d-8e98-ab202f582520 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:21 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdbda542-9f9b-468d-a6e6-537068492890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee0923e-282d-45de-a1ef-536857919988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 1073741824 Nov 02 09:51:21 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 (771d636f-f3e7-4e0e-a2df-d06b56b93be7): created successfully Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee0923e-282d-45de-a1ef-536857919988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (b8611019-cd2a-451b-8532-06ffe95e467a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6c629bb7-1a0b-4122-aad9-9e7dd3393b69 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (e64ed47a-cb40-48bf-9627-899179a3e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da81443d-0681-4284-a116-098ac1a6d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da81443d-0681-4284-a116-098ac1a6d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980671769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaddb96-3ebe-424b-af9e-95aaf30af448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:22Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9802aec8-b0dd-4a5a-a6cc-a4798f6075e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9802aec8-b0dd-4a5a-a6cc-a4798f6075e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a486e4e-6987-4c93-9f9d-992a500ac86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a486e4e-6987-4c93-9f9d-992a500ac86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaddb96-3ebe-424b-af9e-95aaf30af448', 'volume_name': 'volume-faaddb96-3ebe-424b-af9e-95aaf30af448', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a21bf-e4a0-4444-a285-19ece3aa8265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11a21bf-e4a0-4444-a285-19ece3aa8265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d02095-6d0e-4cb7-a54f-b8040fc4eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume faaddb96-3ebe-424b-af9e-95aaf30af448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaddb96-3ebe-424b-af9e-95aaf30af448', 'volume_size': 1} Nov 02 09:51:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:22 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 1073741824" returned: 0 in 0.857s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (97e9d8c3-c5dc-4ded-847a-aeb13c325441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9099625f-d8ec-49bf-8f2b-4f115faaacfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:22 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 Nov 02 09:51:22 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9099625f-d8ec-49bf-8f2b-4f115faaacfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580142891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00242442-1699-40f6-8921-2e3f8b7cf86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:22Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b16e31-045d-4796-b839-614a2a82abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b16e31-045d-4796-b839-614a2a82abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3816cef-06f9-41c3-8df8-bc1757b3a810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3816cef-06f9-41c3-8df8-bc1757b3a810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00242442-1699-40f6-8921-2e3f8b7cf86d', 'volume_name': 'volume-00242442-1699-40f6-8921-2e3f8b7cf86d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb19bd9-a304-401c-bdbc-6b27d8f1e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb19bd9-a304-401c-bdbc-6b27d8f1e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049f2114-90bb-427e-9a4f-b6570e5f92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume 00242442-1699-40f6-8921-2e3f8b7cf86d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00242442-1699-40f6-8921-2e3f8b7cf86d', 'volume_size': 1} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:22 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520" returned: 0 in 0.310s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-480391711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04cd292-27f6-4038-adcd-25220e6bff53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:21Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume e04cd292-27f6-4038-adcd-25220e6bff53 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:22 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:22 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 1073741824 Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a1756ac-b609-46ac-aa95-16d10d516faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4494376-3834-4b1d-8e98-ab202f582520', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6189b765-0ced-447a-bf00-9b2a0343447f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-e4494376-3834-4b1d-8e98-ab202f582520 (e4494376-3834-4b1d-8e98-ab202f582520): created successfully Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6189b765-0ced-447a-bf00-9b2a0343447f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (a624cc36-1401-40b9-8859-9776f12cfd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-eaf2acae-9235-47a4-bf6a-76f43e4fe806 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:23 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 1073741824" returned: 0 in 0.543s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:23 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 Nov 02 09:51:23 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:23 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53" returned: 0 in 0.321s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1980671769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaddb96-3ebe-424b-af9e-95aaf30af448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:22Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume faaddb96-3ebe-424b-af9e-95aaf30af448 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4626dde-ce27-423a-8fed-436ad8f75731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04cd292-27f6-4038-adcd-25220e6bff53', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:23 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 1073741824 Nov 02 09:51:23 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6e0ed9-21e6-4ff4-ac99-6b4cb0983049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-e04cd292-27f6-4038-adcd-25220e6bff53 (e04cd292-27f6-4038-adcd-25220e6bff53): created successfully Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6e0ed9-21e6-4ff4-ac99-6b4cb0983049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (e52333b9-243b-463e-ba57-bd3f55647e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ff7e5a4b-9ded-4b5f-8e6e-eb42c632ae72 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:24 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 1073741824" returned: 0 in 0.660s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:24 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 Nov 02 09:51:24 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:24 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448" returned: 0 in 0.350s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580142891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00242442-1699-40f6-8921-2e3f8b7cf86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9b72b6efc2f41b7a664e6ef56a250f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:22Z,use_quota=True,user_id='2c9e280fe75f4bc2ba4b7d32238d6c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Creating volume 00242442-1699-40f6-8921-2e3f8b7cf86d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:24 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d02095-6d0e-4cb7-a54f-b8040fc4eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaddb96-3ebe-424b-af9e-95aaf30af448', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:24 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d 1073741824 Nov 02 09:51:24 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf849d5b-1ac8-4e75-9482-142bffea04bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:24 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-faaddb96-3ebe-424b-af9e-95aaf30af448 (faaddb96-3ebe-424b-af9e-95aaf30af448): created successfully Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf849d5b-1ac8-4e75-9482-142bffea04bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (e64ed47a-cb40-48bf-9627-899179a3e214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a0c774df-a309-4438-86ee-fb118349cdcf tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:25 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d 1073741824" returned: 0 in 0.543s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:25 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d Nov 02 09:51:25 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:25 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d" returned: 0 in 0.444s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049f2114-90bb-427e-9a4f-b6570e5f92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00242442-1699-40f6-8921-2e3f8b7cf86d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575a1c30-811f-45c3-a58e-eff4da54cf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Volume volume-00242442-1699-40f6-8921-2e3f8b7cf86d (00242442-1699-40f6-8921-2e3f8b7cf86d): created successfully Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575a1c30-811f-45c3-a58e-eff4da54cf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Flow 'volume_create_manager' (97e9d8c3-c5dc-4ded-847a-aeb13c325441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d57bbca3-9801-4bae-8d4d-358ea3c0ed15 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created volume successfully. Nov 02 09:51:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-00242442-1699-40f6-8921-2e3f8b7cf86d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-00242442-1699-40f6-8921-2e3f8b7cf86d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-00242442-1699-40f6-8921-2e3f8b7cf86d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-00242442-1699-40f6-8921-2e3f8b7cf86d" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:27 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d681fb7e-561d-40f6-b33c-22e6c1f951fb]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:27 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d Nov 02 09:51:27 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:27 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d" returned: 0 in 0.594s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:27 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d Nov 02 09:51:27 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:28 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-00242442-1699-40f6-8921-2e3f8b7cf86d" returned: 0 in 0.490s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-00242442-1699-40f6-8921-2e3f8b7cf86d" released by "delete_volume" :: held 1.180s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=81,cinder:UPDATE=78,cinder:INSERT=14,cinder:DELETE=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=83,cinder:SELECT=77,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['73ca6008-2a36-411d-baf3-e83e7b136352', '03be029a-9192-4d2d-a651-593d5d28df81', '38d6288c-8887-43a6-af39-022319ccb78a', '0b9269a4-7cf0-4d9b-970f-01cb74a8b81f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:28 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:28 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:28 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:28 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2dd215d8-46a8-4842-aabb-01c0bcf30912 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-00242442-1699-40f6-8921-2e3f8b7cf86d-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-faaddb96-3ebe-424b-af9e-95aaf30af448-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-faaddb96-3ebe-424b-af9e-95aaf30af448-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-faaddb96-3ebe-424b-af9e-95aaf30af448" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-faaddb96-3ebe-424b-af9e-95aaf30af448" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cd1ca-3bb9-4ed9-a1b8-81ebdff1af99]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:29 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 Nov 02 09:51:29 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:30 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448" returned: 0 in 0.509s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:30 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448 Nov 02 09:51:30 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:30 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-faaddb96-3ebe-424b-af9e-95aaf30af448" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-faaddb96-3ebe-424b-af9e-95aaf30af448" released by "delete_volume" :: held 0.995s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['65a4e0dc-a354-4a77-8c85-cd8279f5ec6c', '9166fdb2-1f76-41c5-93de-0070d75ba3bc', '0ba7db4d-3d5c-4d0f-8859-a0d272200be0', '562dc3b4-b919-4772-a57f-fec039bb4d03'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:30 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:30 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:30 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.348s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7437141f-8d23-4e35-adfc-a3f874dcf56f tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-faaddb96-3ebe-424b-af9e-95aaf30af448-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a35af273-f0fe-4c29-80b2-c4611650c61f req-6eb00972-6441-4746-9a5d-3922e91df274 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a35af273-f0fe-4c29-80b2-c4611650c61f req-6eb00972-6441-4746-9a5d-3922e91df274 tempest-TestStampPattern-225850282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a35af273-f0fe-4c29-80b2-c4611650c61f req-6eb00972-6441-4746-9a5d-3922e91df274 tempest-TestStampPattern-225850282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-a35af273-f0fe-4c29-80b2-c4611650c61f req-6eb00972-6441-4746-9a5d-3922e91df274 tempest-TestStampPattern-225850282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3f4778a-da74-4ead-b75d-8946be7629ea', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:51:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-a35af273-f0fe-4c29-80b2-c4611650c61f req-6eb00972-6441-4746-9a5d-3922e91df274 tempest-TestStampPattern-225850282 None] attachment_update completed successfully. Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-e04cd292-27f6-4038-adcd-25220e6bff53-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-e04cd292-27f6-4038-adcd-25220e6bff53-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-e04cd292-27f6-4038-adcd-25220e6bff53" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-e04cd292-27f6-4038-adcd-25220e6bff53" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed24549-ec25-44bc-a99f-f95317f35a2b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:32 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 Nov 02 09:51:32 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:32 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53" returned: 0 in 0.576s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:32 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53 Nov 02 09:51:32 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:32 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e04cd292-27f6-4038-adcd-25220e6bff53" returned: 0 in 0.419s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-e04cd292-27f6-4038-adcd-25220e6bff53" released by "delete_volume" :: held 1.092s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['cad8f49e-49db-489a-978d-92a31f3e9192', '0604741b-fc72-41b9-bfc9-d2204aaf5a77', 'd1e578aa-46e0-45ee-9a6a-19b9262d2e3a', 'a5239fb2-c87c-4328-ad13-62c7c6a7e54a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:33 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:33 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:33 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.329s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b65eee37-ae0d-41e8-b696-f671a4cdc48e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-e04cd292-27f6-4038-adcd-25220e6bff53-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-e4494376-3834-4b1d-8e98-ab202f582520-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-e4494376-3834-4b1d-8e98-ab202f582520-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-e4494376-3834-4b1d-8e98-ab202f582520" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-e4494376-3834-4b1d-8e98-ab202f582520" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c581b0cc-7479-44a1-bacd-524c4acd9598]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:34 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 Nov 02 09:51:34 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:34 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:34 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520 Nov 02 09:51:34 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:35 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e4494376-3834-4b1d-8e98-ab202f582520" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-e4494376-3834-4b1d-8e98-ab202f582520" released by "delete_volume" :: held 0.946s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['806d915f-bcc7-418e-8f96-3a2e06b887ea', '19aa8a78-eeb3-4e60-9f7b-c0b63610c61f', '2adbb6c4-cc5f-4806-941a-ba37832a7ef2', 'b258b2f2-3e02-4671-a830-3a1e75145839'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:35 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:35 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-9a193034-8a74-4f70-acf2-9e3fcba45f20 req-3bf20204-f91c-46fd-98a9-0e5acca95adf tempest-TestStampPattern-225850282 None] Terminate volume connection completed successfully. Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-9a193034-8a74-4f70-acf2-9e3fcba45f20 req-3bf20204-f91c-46fd-98a9-0e5acca95adf tempest-TestStampPattern-225850282 None] Deleting attachment c3f4778a-da74-4ead-b75d-8946be7629ea. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:51:35 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04b605f4-c597-453c-8558-6b3362ad261e tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-e4494376-3834-4b1d-8e98-ab202f582520-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-771d636f-f3e7-4e0e-a2df-d06b56b93be7-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-771d636f-f3e7-4e0e-a2df-d06b56b93be7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-771d636f-f3e7-4e0e-a2df-d06b56b93be7" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-771d636f-f3e7-4e0e-a2df-d06b56b93be7" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb73047-6733-419d-a80f-d00413986bbc]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:36 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 Nov 02 09:51:36 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:37 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7" returned: 0 in 0.649s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:37 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7 Nov 02 09:51:37 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:37 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-771d636f-f3e7-4e0e-a2df-d06b56b93be7" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-771d636f-f3e7-4e0e-a2df-d06b56b93be7" released by "delete_volume" :: held 1.274s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:37 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['c3a271c7-f993-49ca-a5be-4c38bf1f03fb', 'b3079205-d841-4dad-8ae2-d0368d0db09c', '0a6c138f-7f13-4209-8566-027dfd8e0a92', 'd1bf1f92-a38e-4b6b-a4aa-f5994366831d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:38 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:38 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:38 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.356s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-87bf9eb1-03a1-4fef-bcd1-fb3575b619a5 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-771d636f-f3e7-4e0e-a2df-d06b56b93be7-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-8a3bd953-9a72-4135-a3e9-6692d0a96a2b-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-8a3bd953-9a72-4135-a3e9-6692d0a96a2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-8a3bd953-9a72-4135-a3e9-6692d0a96a2b" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-8a3bd953-9a72-4135-a3e9-6692d0a96a2b" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleting offline snapshot 8a3bd953-9a72-4135-a3e9-6692d0a96a2b of volume 21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] snapshot_file for this snap is: volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c0710-73ed-4efb-8634-c00b0b1a7cb4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:39 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b Nov 02 09:51:39 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:39 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b" returned: 0 in 0.543s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21857eb9-bc8c-49e2-b420-ec6560632f26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:51:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6156af32-4344-496a-a8ea-eb1108e97112]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:39 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 Nov 02 09:51:39 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:40 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26" returned: 0 in 0.782s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:40 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b Nov 02 09:51:40 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:40 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b" returned: 0 in 0.500s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:40 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b Nov 02 09:51:40 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "cinder-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:41 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26.8a3bd953-9a72-4135-a3e9-6692d0a96a2b" returned: 0 in 0.421s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a7996-18a9-4571-902e-d60e39e86843]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-8a3bd953-9a72-4135-a3e9-6692d0a96a2b" released by "_delete_snapshot" :: held 2.431s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" released by "delete_snapshot" :: held 2.494s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['74860df4-5491-4ae5-8f9d-fc7b2d3ac140', '39e257d5-0f3a-4ecb-8839-8d961d7a8a06', '6df11c53-e228-4065-b444-4cee64c78889', '127ec5df-cd96-479b-956c-1984048efb94'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:41 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 Nov 02 09:51:41 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Delete snapshot completed successfully. Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9b1b8956-942c-43bb-9398-13c367552338 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-8a3bd953-9a72-4135-a3e9-6692d0a96a2b-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:41 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" returned: 0 in 0.540s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:41 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2 Nov 02 09:51:41 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-21857eb9-bc8c-49e2-b420-ec6560632f26-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-21857eb9-bc8c-49e2-b420-ec6560632f26-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:42 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b438c1-9212-4e11-9394-bd784afc091a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2" released by "delete_volume" :: held 1.147s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Created reservations ['bf601d5b-29ce-48ad-9315-219bb65a7eb4', '1e5dd5c3-8623-47ac-b911-2ccc844f1749', 'ea99a8d2-8dd1-4cb3-97ba-7c08c93edf74', 'd9e5f8ac-1f00-4e31-ad69-088e969c8e27'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:42 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 Nov 02 09:51:42 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:42 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:42 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:43 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26" returned: 0 in 0.636s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:43 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26 Nov 02 09:51:43 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:43 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.596s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Deleted volume successfully. Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4d380cc7-edcf-421c-815d-f50a2f435c51 tempest-TestStampPattern-225850282 None] Lock "cinder-fd701f61-f7f1-48c7-8ebd-4ecb14c260a2-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:43 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-21857eb9-bc8c-49e2-b420-ec6560632f26" returned: 0 in 0.799s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-quobyte-21857eb9-bc8c-49e2-b420-ec6560632f26" released by "delete_volume" :: held 1.553s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:43 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Created reservations ['f66c7ba9-2432-4e96-ad90-f839751c5a39', '06bc7e4f-ad66-4d90-9106-e6407050df95', 'b9a933c3-cc40-460a-89e8-7f8466b54dc1', '5bfe472f-957c-4223-89b1-1d6ae6110ef2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:44 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:44 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-5be5c99b-84a4-4f98-b1cd-de19515c3176-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-5be5c99b-84a4-4f98-b1cd-de19515c3176-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Deleting offline snapshot 5be5c99b-84a4-4f98-b1cd-de19515c3176 of volume 5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] snapshot_file for this snap is: volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af98937-91a3-4159-91d6-75b5781ce178]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:44 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.444s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Deleted volume successfully. Nov 02 09:51:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-36138476-1262-4c82-b482-0be69e9eb3a8 tempest-CreateVolumesFromSnapshotTest-851287574 None] Lock "cinder-21857eb9-bc8c-49e2-b420-ec6560632f26-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:44 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:51:44 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:45 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.760s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:51:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4207e84-05a3-46af-85be-d7d018398016]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:45 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:51:45 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:46 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.888s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:46 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:51:46 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:47 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.660s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:47 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176 Nov 02 09:51:47 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:47 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3.5be5c99b-84a4-4f98-b1cd-de19515c3176" returned: 0 in 0.463s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5be5c99b-84a4-4f98-b1cd-de19515c3176" released by "_delete_snapshot" :: held 3.061s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" released by "delete_snapshot" :: held 3.133s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Created reservations ['c6d2cdda-cdf3-4e72-8249-3451f9de4810', 'ff1388c7-83ee-4ddb-8154-6e7eabfe6bdf', 'f12b51e4-16c6-46b5-988a-bd601ba6b48f', '91809826-81fc-4e56-92b3-4dfdfc45d717'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Delete snapshot completed successfully. Nov 02 09:51:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-63460ccd-0d1d-4ec8-b2ce-bd4f44626923 tempest-TestStampPattern-225850282 None] Lock "cinder-5be5c99b-84a4-4f98-b1cd-de19515c3176-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (1bac2d43-6ec7-4509-ad1b-4c46ac6d75b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca982614-b7a9-421d-88b1-9d5529b9b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca982614-b7a9-421d-88b1-9d5529b9b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318589028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69ac090-3f83-44f7-9098-af3013f1d1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:48Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686d4708-0fde-4bc9-90f9-32448f9a9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686d4708-0fde-4bc9-90f9-32448f9a9894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bed7d75-b0a3-4b05-b19d-f58f6639f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bed7d75-b0a3-4b05-b19d-f58f6639f48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69ac090-3f83-44f7-9098-af3013f1d1cc', 'volume_name': 'volume-d69ac090-3f83-44f7-9098-af3013f1d1cc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0456cc95-8418-453b-8464-05caa4e9452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0456cc95-8418-453b-8464-05caa4e9452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9699a9-d77b-458d-b94a-3d61b59d2bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Volume d69ac090-3f83-44f7-9098-af3013f1d1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69ac090-3f83-44f7-9098-af3013f1d1cc', 'volume_size': 1} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-318589028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69ac090-3f83-44f7-9098-af3013f1d1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:48Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Creating volume d69ac090-3f83-44f7-9098-af3013f1d1cc {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:48 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:48 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc 1073741824 Nov 02 09:51:48 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:49 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc 1073741824" returned: 0 in 0.767s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:49 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc Nov 02 09:51:49 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:49 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9699a9-d77b-458d-b94a-3d61b59d2bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69ac090-3f83-44f7-9098-af3013f1d1cc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497a7501-38e2-40b4-b96f-fd33e023bfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:49 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Volume volume-d69ac090-3f83-44f7-9098-af3013f1d1cc (d69ac090-3f83-44f7-9098-af3013f1d1cc): created successfully Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497a7501-38e2-40b4-b96f-fd33e023bfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (1bac2d43-6ec7-4509-ad1b-4c46ac6d75b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b8652aa9-571f-4685-b223-08365d69337a tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (e2b7a987-d354-458e-a995-9c8ba2e62da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36391ec2-5293-452e-a470-e15115aa9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36391ec2-5293-452e-a470-e15115aa9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086230055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de2a62-d4af-4ca2-81cc-c6b223fefa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:50Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869de1dc-6f61-4e92-b541-beb2aec3b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869de1dc-6f61-4e92-b541-beb2aec3b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9550e51-9a81-4f3e-8479-0c631acc4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9550e51-9a81-4f3e-8479-0c631acc4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63de2a62-d4af-4ca2-81cc-c6b223fefa7f', 'volume_name': 'volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d3cd2e-3f44-4667-83f5-c5fda2c28ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d3cd2e-3f44-4667-83f5-c5fda2c28ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62d3985-e5e4-4784-9af7-ec879a1dd82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume 63de2a62-d4af-4ca2-81cc-c6b223fefa7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f', 'volume_size': 1} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1086230055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63de2a62-d4af-4ca2-81cc-c6b223fefa7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:50Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume 63de2a62-d4af-4ca2-81cc-c6b223fefa7f {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:50 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5bda5938-2585-4a0e-ba1e-21374a46c190 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc" by "attach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5bda5938-2585-4a0e-ba1e-21374a46c190 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc" acquired by "attach_volume" :: waited 0.035s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:50 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f 1073741824 Nov 02 09:51:50 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5bda5938-2585-4a0e-ba1e-21374a46c190 tempest-VolumesActionsTest-1249731556 None] Attaching volume d69ac090-3f83-44f7-9098-af3013f1d1cc to instance bae76668-df39-4a95-95da-daf188dac9dc at mountpoint /dev/vdb on host None. Nov 02 09:51:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5bda5938-2585-4a0e-ba1e-21374a46c190 tempest-VolumesActionsTest-1249731556 None] Attach volume completed successfully. Nov 02 09:51:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5bda5938-2585-4a0e-ba1e-21374a46c190 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc" released by "attach_volume" :: held 0.220s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:51 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f 1073741824" returned: 0 in 1.383s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:52 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f Nov 02 09:51:52 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:52 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" returned: 0 in 0.548s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62d3985-e5e4-4784-9af7-ec879a1dd82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85906f0c-c294-4109-bf1e-62dcc8927574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:52 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f (63de2a62-d4af-4ca2-81cc-c6b223fefa7f): created successfully Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85906f0c-c294-4109-bf1e-62dcc8927574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (e2b7a987-d354-458e-a995-9c8ba2e62da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Terminate volume connection completed successfully. Nov 02 09:51:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c3a3956a-99d3-4b61-8cae-ed7fcd9bdb2e tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" by "detach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Detaching volume d69ac090-3f83-44f7-9098-af3013f1d1cc from instance bae76668-df39-4a95-95da-daf188dac9dc. Nov 02 09:51:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Detach volume completed successfully. Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6ad77209-5198-4541-9763-160e8d7b2c9a tempest-VolumesActionsTest-995848030 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf123c03-7a6c-4322-9b8c-615b95461654 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" by "detach_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf123c03-7a6c-4322-9b8c-615b95461654 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bf123c03-7a6c-4322-9b8c-615b95461654 tempest-VolumesActionsTest-1249731556 None] Volume detach called, but volume not attached. Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf123c03-7a6c-4322-9b8c-615b95461654 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-quobyte-d69ac090-3f83-44f7-9098-af3013f1d1cc" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-quobyte-d69ac090-3f83-44f7-9098-af3013f1d1cc" acquired by "delete_volume" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a9364-e41f-43e2-bffa-5b2a504a9455]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:54 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc Nov 02 09:51:54 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-5bdfddd4-1647-4b92-ac8f-90605d2793f3-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "cinder-5bdfddd4-1647-4b92-ac8f-90605d2793f3-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (f3362243-a037-404b-a739-8b5316d04393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8faa2-8f7a-43d6-90df-aeb6f5a35417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:54 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd8faa2-8f7a-43d6-90df-aeb6f5a35417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683288218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0906e714-116e-4b0d-90ea-dadd295d5883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:55Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca46ea9-c968-403a-ae68-3c0253998326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca46ea9-c968-403a-ae68-3c0253998326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da67ee1e-78ca-4f6a-aaa7-95391de4de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da67ee1e-78ca-4f6a-aaa7-95391de4de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0906e714-116e-4b0d-90ea-dadd295d5883', 'volume_name': 'volume-0906e714-116e-4b0d-90ea-dadd295d5883', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df272853-a676-4374-ad95-64109afcba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df272853-a676-4374-ad95-64109afcba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98109d-1616-4bbf-9c81-6b053ea00650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume 0906e714-116e-4b0d-90ea-dadd295d5883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0906e714-116e-4b0d-90ea-dadd295d5883', 'volume_size': 1} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683288218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0906e714-116e-4b0d-90ea-dadd295d5883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:55Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume 0906e714-116e-4b0d-90ea-dadd295d5883 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:55 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc" returned: 0 in 1.021s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:55 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 1073741824 Nov 02 09:51:55 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Acquiring lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:51:55 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc Nov 02 09:51:55 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b333df-6307-4b60-b5fa-fd1b5daa9196]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (c00b3920-fe41-4d6d-ae30-8b45a08f7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43cfaca-aa8d-454e-90ff-caf1e1de6c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43cfaca-aa8d-454e-90ff-caf1e1de6c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399782524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5564e8-072b-415d-a1bb-4a6b071222cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:55Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f19aeb9-d39d-473b-9575-c6ee0c8571aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:51:55 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f19aeb9-d39d-473b-9575-c6ee0c8571aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fde9c3-876c-475d-98e9-af3ec4461361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fde9c3-876c-475d-98e9-af3ec4461361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5564e8-072b-415d-a1bb-4a6b071222cd', 'volume_name': 'volume-7d5564e8-072b-415d-a1bb-4a6b071222cd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2ebd9b-8c90-4b20-a051-7f65f8f7559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2ebd9b-8c90-4b20-a051-7f65f8f7559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdac5c0-8fe7-41e2-8d59-bd385997f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:55 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume 7d5564e8-072b-415d-a1bb-4a6b071222cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5564e8-072b-415d-a1bb-4a6b071222cd', 'volume_size': 1} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:55 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d69ac090-3f83-44f7-9098-af3013f1d1cc" returned: 0 in 0.533s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-quobyte-d69ac090-3f83-44f7-9098-af3013f1d1cc" released by "delete_volume" :: held 1.677s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Created reservations ['04079047-7f38-4e54-a156-87afa2fe7b30', '169549e3-efc4-4abd-bdcd-38172a93602f', '8d12ac31-aa1c-4f29-b496-3e3641b75038', '93628e76-a0f1-4c16-8c5c-fe3480e6e758'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:56 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:56 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:56 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 1073741824" returned: 0 in 1.023s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:56 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.826s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:56 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3 Nov 02 09:51:56 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (3927d6f6-990c-4648-a850-ca5cb0d53d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37def8f-4565-4423-bc83-4eb9d61a0200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37def8f-4565-4423-bc83-4eb9d61a0200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130853434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:56Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c6fcd7-3a71-4f8c-a26d-0c73d694e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c6fcd7-3a71-4f8c-a26d-0c73d694e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4cb46-ab2f-4f63-b458-ff558125dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4cb46-ab2f-4f63-b458-ff558125dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0', 'volume_name': 'volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a06d31-9e35-48cc-96c9-dc83cb73f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a06d31-9e35-48cc-96c9-dc83cb73f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8c4ad-bce5-40bc-a429-7eb2e5b5fca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0', 'volume_size': 1} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:56 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 Nov 02 09:51:56 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:56 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.634s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Deleted volume successfully. Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7a30ebb3-e0ab-4e37-9303-19eadda818a3 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-d69ac090-3f83-44f7-9098-af3013f1d1cc-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:56 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-5bdfddd4-1647-4b92-ac8f-90605d2793f3" returned: 0 in 0.801s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "cinder-quobyte-5bdfddd4-1647-4b92-ac8f-90605d2793f3" released by "delete_volume" :: held 1.823s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:57 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883" returned: 0 in 0.637s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.145s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-399782524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5564e8-072b-415d-a1bb-4a6b071222cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:55Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume 7d5564e8-072b-415d-a1bb-4a6b071222cd {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:57 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Created reservations ['f192ad98-f8e8-4c97-b315-6854eeb7218d', 'd4c3de12-0290-4845-a70b-8d96dec8c0e4', '8b745934-ce88-470c-a503-5ec514daf0b5', '361d195f-2d5f-4210-bacd-5da7b0089464'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:51:57 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd 1073741824 Nov 02 09:51:57 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db98109d-1616-4bbf-9c81-6b053ea00650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0906e714-116e-4b0d-90ea-dadd295d5883', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21868b06-d99a-42f3-9b27-c7678cc9dd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-0906e714-116e-4b0d-90ea-dadd295d5883 (0906e714-116e-4b0d-90ea-dadd295d5883): created successfully Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21868b06-d99a-42f3-9b27-c7678cc9dd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (f3362243-a037-404b-a739-8b5316d04393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (3383ef92-4c2b-435c-be75-b74dcb0d5758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902b270-2fca-4bab-804a-325abf600bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-721b78cc-e04e-4ed6-9dfa-1be44171673c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c902b270-2fca-4bab-804a-325abf600bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774583188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f9383-3214-4fee-bb3e-4bf0841d7356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:57Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd54c87-9bb8-4ede-ad45-a284ef88d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd54c87-9bb8-4ede-ad45-a284ef88d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141b0026-e858-4490-9ac7-20aee322210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141b0026-e858-4490-9ac7-20aee322210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b5f9383-3214-4fee-bb3e-4bf0841d7356', 'volume_name': 'volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb951453-43e0-44d9-9567-ac0fb0426e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb951453-43e0-44d9-9567-ac0fb0426e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94929e4a-94b0-49ab-88ab-66d2fda5a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume 9b5f9383-3214-4fee-bb3e-4bf0841d7356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356', 'volume_size': 1} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:57 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:57 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:58 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd 1073741824" returned: 0 in 0.908s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:51:58 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:51:58 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (d42acf44-bce9-4344-a4f0-280937696929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba02bbe3-17c1-4bb4-b73a-e1753336ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:58 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd Nov 02 09:51:58 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba02bbe3-17c1-4bb4-b73a-e1753336ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331468077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c98d63-d72e-4b4a-b6d0-ef294b3413a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:58Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dbc112-fd8c-497a-be26-7d17c15e4240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07dbc112-fd8c-497a-be26-7d17c15e4240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c7becf-5c7f-4b49-a075-5080643729f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c7becf-5c7f-4b49-a075-5080643729f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c98d63-d72e-4b4a-b6d0-ef294b3413a6', 'volume_name': 'volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319449ad-b2ec-4607-8a1e-f48cbd92a46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319449ad-b2ec-4607-8a1e-f48cbd92a46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f95dc26-9436-468b-b885-fc7f1fe22314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume 98c98d63-d72e-4b4a-b6d0-ef294b3413a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6', 'volume_size': 1} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.601s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Deleted volume successfully. Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-998ae018-d68e-470e-9c70-acac063b8963 tempest-TestStampPattern-225850282 None] Lock "cinder-5bdfddd4-1647-4b92-ac8f-90605d2793f3-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:51:58 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.405s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:51:58 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd" returned: 0 in 0.413s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.166s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130853434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:56Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:58 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdac5c0-8fe7-41e2-8d59-bd385997f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5564e8-072b-415d-a1bb-4a6b071222cd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1a93ad-5cf7-4369-a895-bd5417ffd8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:58 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 1073741824 Nov 02 09:51:58 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:58 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-7d5564e8-072b-415d-a1bb-4a6b071222cd (7d5564e8-072b-415d-a1bb-4a6b071222cd): created successfully Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1a93ad-5cf7-4369-a895-bd5417ffd8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (c00b3920-fe41-4d6d-ae30-8b45a08f7a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:51:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3fd3f5bf-74ab-47ef-9624-b18c745b97c0 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:51:59 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 1073741824" returned: 0 in 0.792s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:59 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 Nov 02 09:51:59 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:59 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.099s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774583188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b5f9383-3214-4fee-bb3e-4bf0841d7356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:57Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume 9b5f9383-3214-4fee-bb3e-4bf0841d7356 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:51:59 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8c4ad-bce5-40bc-a429-7eb2e5b5fca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:59 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 1073741824 Nov 02 09:51:59 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748ee43e-66db-4514-bbb4-39fae1b4d70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:51:59 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 (edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0): created successfully Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748ee43e-66db-4514-bbb4-39fae1b4d70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:51:59 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (3927d6f6-990c-4648-a850-ca5cb0d53d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-649814f6-420b-4924-ad1f-1ef9493ae30f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:52:00 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 1073741824" returned: 0 in 0.685s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:00 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 Nov 02 09:52:00 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:00 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356" returned: 0 in 0.348s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.540s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331468077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c98d63-d72e-4b4a-b6d0-ef294b3413a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4d5b6ef2b4b9bb96891645b9e62e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:51:58Z,use_quota=True,user_id='371852fc827e4714aded3590fca24ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Creating volume 98c98d63-d72e-4b4a-b6d0-ef294b3413a6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:00 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:01 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 1073741824 Nov 02 09:52:01 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94929e4a-94b0-49ab-88ab-66d2fda5a94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e478008d-9f87-4d0c-ab37-3d8ef54c4602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 (9b5f9383-3214-4fee-bb3e-4bf0841d7356): created successfully Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e478008d-9f87-4d0c-ab37-3d8ef54c4602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (3383ef92-4c2b-435c-be75-b74dcb0d5758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fee45bf3-4e20-45ef-8ff8-3ad63fcc4d5a tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (cafbd33e-8428-46dd-904a-d210a9f42b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3eb578-e325-4967-82d3-358f2d15c181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3eb578-e325-4967-82d3-358f2d15c181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-873849144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892b97ef-4e78-487e-a76e-61d31cf1aeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:01Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9b3359-944f-4c08-80e2-e8704dc33bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9b3359-944f-4c08-80e2-e8704dc33bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d228a5b-ae62-421e-9740-f5c10ffa6ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d228a5b-ae62-421e-9740-f5c10ffa6ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '892b97ef-4e78-487e-a76e-61d31cf1aeca', 'volume_name': 'volume-892b97ef-4e78-487e-a76e-61d31cf1aeca', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce0a58-5913-43b7-b9eb-2866dc793513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ce0a58-5913-43b7-b9eb-2866dc793513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4372e1-351d-442a-ab7f-400d1daef413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Volume 892b97ef-4e78-487e-a76e-61d31cf1aeca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-892b97ef-4e78-487e-a76e-61d31cf1aeca', 'volume_size': 1} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:01 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 1073741824" returned: 0 in 0.597s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:01 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 Nov 02 09:52:01 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:01 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" returned: 0 in 0.261s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-873849144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892b97ef-4e78-487e-a76e-61d31cf1aeca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:01Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Creating volume 892b97ef-4e78-487e-a76e-61d31cf1aeca {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f95dc26-9436-468b-b885-fc7f1fe22314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca 1073741824 Nov 02 09:52:01 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a58478-046e-4cb7-9284-e305dde07bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Volume volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 (98c98d63-d72e-4b4a-b6d0-ef294b3413a6): created successfully Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a58478-046e-4cb7-9284-e305dde07bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Flow 'volume_create_manager' (d42acf44-bce9-4344-a4f0-280937696929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c4fb0142-0c6f-4ff8-9e3a-868610939994 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created volume successfully. Nov 02 09:52:02 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca 1073741824" returned: 0 in 0.513s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:02 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca Nov 02 09:52:02 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:02 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4372e1-351d-442a-ab7f-400d1daef413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892b97ef-4e78-487e-a76e-61d31cf1aeca', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10238857-7be6-417e-acf9-9f2c4d09af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-98c98d63-d72e-4b4a-b6d0-ef294b3413a6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Volume volume-892b97ef-4e78-487e-a76e-61d31cf1aeca (892b97ef-4e78-487e-a76e-61d31cf1aeca): created successfully Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10238857-7be6-417e-acf9-9f2c4d09af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (cafbd33e-8428-46dd-904a-d210a9f42b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-98c98d63-d72e-4b4a-b6d0-ef294b3413a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3acebb0a-8a66-4e30-b7bf-6212deaedcdd tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e39589-dadc-434c-a290-006e0f305273]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:03 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 Nov 02 09:52:03 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:03 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" returned: 0 in 0.444s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:03 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6 Nov 02 09:52:03 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-892b97ef-4e78-487e-a76e-61d31cf1aeca-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "cinder-892b97ef-4e78-487e-a76e-61d31cf1aeca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-quobyte-892b97ef-4e78-487e-a76e-61d31cf1aeca" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-892b97ef-4e78-487e-a76e-61d31cf1aeca" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:03 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" returned: 0 in 0.538s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a5692-7cf2-4932-9a01-19d4ca08e47b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-98c98d63-d72e-4b4a-b6d0-ef294b3413a6" released by "delete_volume" :: held 1.063s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['2e0f39ec-cc6f-447b-9429-3f9dbd40f9df', '5fed386e-ab19-458a-b7f1-1404031ec265', 'e1b04ef8-8f95-4d64-944e-2237f959207f', '903f656d-061d-469d-b34c-90ea6c2bec5f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:04 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca Nov 02 09:52:04 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:04 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:04 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:04 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca" returned: 0 in 0.530s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:04 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.372s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:04 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca Nov 02 09:52:04 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0fc97be0-5e55-4d49-ac7c-b5b9bc1b255c tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-98c98d63-d72e-4b4a-b6d0-ef294b3413a6-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:04 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-892b97ef-4e78-487e-a76e-61d31cf1aeca" returned: 0 in 0.389s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-892b97ef-4e78-487e-a76e-61d31cf1aeca" released by "delete_volume" :: held 1.006s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:04 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Created reservations ['0da2de15-cc17-46e9-bac5-1f4afa2e28d3', 'd35d674f-4019-4dba-8289-cd4e09afeb7d', 'b5c4e6fd-a710-4cc8-9b0f-0b29b301c40c', '9f38471e-db62-4a4d-b4ab-594c8d2872fd'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-9b5f9383-3214-4fee-bb3e-4bf0841d7356-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:05 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:05 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-9b5f9383-3214-4fee-bb3e-4bf0841d7356-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-9b5f9383-3214-4fee-bb3e-4bf0841d7356" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-9b5f9383-3214-4fee-bb3e-4bf0841d7356" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dcc9c5-3436-47c5-b1a9-3580f9452203]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:05 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 Nov 02 09:52:05 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:05 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Deleted volume successfully. Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-68b445da-603c-432c-967c-c7bd3cdefe3e tempest-VolumesActionsTest-995848030 None] Lock "cinder-892b97ef-4e78-487e-a76e-61d31cf1aeca-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:05 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356" returned: 0 in 0.480s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:05 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356 Nov 02 09:52:05 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:06 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9b5f9383-3214-4fee-bb3e-4bf0841d7356" returned: 0 in 0.432s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-9b5f9383-3214-4fee-bb3e-4bf0841d7356" released by "delete_volume" :: held 0.981s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['ec309e27-a686-4be9-a960-325eb27980c4', '0fbc475f-684d-4080-8bd0-8eca1a5d34f2', '762a2764-d987-4c51-971b-95f098733531', '15819da0-476c-43af-95aa-26e2c8f6b64e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:06 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:06 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:06 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.368s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-feaaa0d9-fbba-44e8-9793-7cd7797c1e67 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-9b5f9383-3214-4fee-bb3e-4bf0841d7356-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (91f0fafa-d8ad-41ec-a78a-b572e2665001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56634a4-ef02-470b-a673-be18746d4703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56634a4-ef02-470b-a673-be18746d4703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573025798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32805e01-776c-40a1-89ee-b37578ff86a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:07Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfac498-202b-4919-96dd-728d5f1ebb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfac498-202b-4919-96dd-728d5f1ebb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56443d29-b087-4bf1-b7f5-0d2c606c78ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56443d29-b087-4bf1-b7f5-0d2c606c78ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32805e01-776c-40a1-89ee-b37578ff86a4', 'volume_name': 'volume-32805e01-776c-40a1-89ee-b37578ff86a4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95afe94d-d1e9-4c0b-b693-62feabf3d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95afe94d-d1e9-4c0b-b693-62feabf3d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9656f0-7912-4a18-9f06-f6281c4fa683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:07 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Volume 32805e01-776c-40a1-89ee-b37578ff86a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32805e01-776c-40a1-89ee-b37578ff86a4', 'volume_size': 1} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573025798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32805e01-776c-40a1-89ee-b37578ff86a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:07Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Creating volume 32805e01-776c-40a1-89ee-b37578ff86a4 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:07 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:07 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 1073741824 Nov 02 09:52:07 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be8d6d-8eb5-494c-8af5-bb2dc9299424]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:07 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 1073741824" returned: 0 in 0.631s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:07 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 Nov 02 09:52:07 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:07 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 Nov 02 09:52:07 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:08 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4" returned: 0 in 0.430s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:08 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" returned: 0 in 0.576s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9656f0-7912-4a18-9f06-f6281c4fa683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32805e01-776c-40a1-89ee-b37578ff86a4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:08 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0 Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec62151c-b93d-4c7b-a453-609b6888ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:08 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:08 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Volume volume-32805e01-776c-40a1-89ee-b37578ff86a4 (32805e01-776c-40a1-89ee-b37578ff86a4): created successfully Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec62151c-b93d-4c7b-a453-609b6888ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (91f0fafa-d8ad-41ec-a78a-b572e2665001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fa09a7a3-5eb9-4272-a7c1-8a43b529b08b tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:52:08 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0" released by "delete_volume" :: held 0.940s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['42496c33-7c4a-4311-be39-ad10421c4df3', '15806e33-7824-445b-adaa-95a4aeddd356', 'c9503312-9a01-41ef-b930-50e89388cd66', '580080cd-bdc7-4dc6-abd5-701b8ce2845c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:08 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:08 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:09 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.342s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-35347ed3-237f-4aea-81cf-8397b899e3d5 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-edf5a397-9899-4d39-a3c5-0ac7e2c7d0a0-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-32805e01-776c-40a1-89ee-b37578ff86a4-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "cinder-32805e01-776c-40a1-89ee-b37578ff86a4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-quobyte-32805e01-776c-40a1-89ee-b37578ff86a4" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-32805e01-776c-40a1-89ee-b37578ff86a4" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987acac-4830-4f63-934d-56397f136a0f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:09 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 Nov 02 09:52:09 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-7d5564e8-072b-415d-a1bb-4a6b071222cd-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:09 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:09 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4 Nov 02 09:52:09 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-7d5564e8-072b-415d-a1bb-4a6b071222cd-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-7d5564e8-072b-415d-a1bb-4a6b071222cd" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-7d5564e8-072b-415d-a1bb-4a6b071222cd" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee17a55-32d0-4415-a892-497cc34ccf43]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:10 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd Nov 02 09:52:10 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:10 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-32805e01-776c-40a1-89ee-b37578ff86a4" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-32805e01-776c-40a1-89ee-b37578ff86a4" released by "delete_volume" :: held 1.059s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Created reservations ['e2578d06-8c71-45d5-8783-67fa4eb5ffef', '4ad520f1-3fcc-4849-9ff0-aeebdcea0692', '58fd178a-9a34-42df-903c-6bfe40db1fb3', '94ad471a-bd35-43a2-8ca9-1dac478cfbd7'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:10 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd" returned: 0 in 0.490s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:10 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:10 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:10 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd Nov 02 09:52:10 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:10 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.332s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:10 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Deleted volume successfully. Nov 02 09:52:10 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7d5564e8-072b-415d-a1bb-4a6b071222cd" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd0bc859-5840-4516-9c53-099adbf6dfa2 tempest-VolumesActionsTest-995848030 None] Lock "cinder-32805e01-776c-40a1-89ee-b37578ff86a4-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-7d5564e8-072b-415d-a1bb-4a6b071222cd" released by "delete_volume" :: held 0.957s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['8d351351-f141-4887-a089-75aa4d980979', '53b1ddd1-165a-4f6b-b791-2dce99a6da34', '720bbe36-57e4-4bb7-ab94-a90bd088f718', 'd5496f8a-56f6-4c07-a114-2fa24a491d75'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:11 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:11 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:11 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.357s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a42f94fa-00ea-4c45-8864-15ff640048d2 tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-7d5564e8-072b-415d-a1bb-4a6b071222cd-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (13105718-d833-472f-8051-b030f7d748c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f80351-1d76-46fb-8ae0-44c03955392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f80351-1d76-46fb-8ae0-44c03955392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125464874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0c630a-5473-49aa-9d7f-4a7dee6edf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:12Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a2cf61-df75-4a60-b332-eb0f7d857b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a2cf61-df75-4a60-b332-eb0f7d857b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706ed85-2e64-44e5-a47d-aa88df0e2c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706ed85-2e64-44e5-a47d-aa88df0e2c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0c630a-5473-49aa-9d7f-4a7dee6edf36', 'volume_name': 'volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6304c87-d00f-49a4-a831-3dc5650be046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6304c87-d00f-49a4-a831-3dc5650be046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529bc41-a260-4166-93c8-4e3d91ae677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Volume ac0c630a-5473-49aa-9d7f-4a7dee6edf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36', 'volume_size': 1} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-125464874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0c630a-5473-49aa-9d7f-4a7dee6edf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:12Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Creating volume ac0c630a-5473-49aa-9d7f-4a7dee6edf36 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:12 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-0906e714-116e-4b0d-90ea-dadd295d5883-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:12 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 1073741824 Nov 02 09:52:12 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-0906e714-116e-4b0d-90ea-dadd295d5883-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-0906e714-116e-4b0d-90ea-dadd295d5883" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-0906e714-116e-4b0d-90ea-dadd295d5883" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b1053e-8245-4162-b2b6-1e9e79219c26]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:12 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 Nov 02 09:52:12 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:12 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 1073741824" returned: 0 in 0.642s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:13 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 Nov 02 09:52:13 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:13 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883" returned: 0 in 0.519s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:13 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883 Nov 02 09:52:13 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:13 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4529bc41-a260-4166-93c8-4e3d91ae677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db59a591-7338-407b-bc84-74dab897d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:13 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0906e714-116e-4b0d-90ea-dadd295d5883" returned: 0 in 0.285s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Volume volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 (ac0c630a-5473-49aa-9d7f-4a7dee6edf36): created successfully Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db59a591-7338-407b-bc84-74dab897d246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (13105718-d833-472f-8051-b030f7d748c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-0906e714-116e-4b0d-90ea-dadd295d5883" released by "delete_volume" :: held 0.880s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3d57cdf6-4367-4949-b86f-2def209f98e9 tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['b04daa21-62f8-4389-8d5d-ce30bed2ce93', '3c6d4896-6b3c-493c-ae52-e79728d68ba0', '7c4eeacc-fe1a-4a2d-b8d3-989d785bc0bb', '9a0dc5dc-cfd7-4267-a322-d12f58a8bc27'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:13 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:13 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:13 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.264s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a10ed4f-6477-416b-8b93-b69298dcdb4f tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-0906e714-116e-4b0d-90ea-dadd295d5883-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-ac0c630a-5473-49aa-9d7f-4a7dee6edf36-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "cinder-ac0c630a-5473-49aa-9d7f-4a7dee6edf36-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-quobyte-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0a731-eca3-4df2-ac00-8c8441b93789]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-63de2a62-d4af-4ca2-81cc-c6b223fefa7f-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-63de2a62-d4af-4ca2-81cc-c6b223fefa7f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "cinder-quobyte-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:14 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 Nov 02 09:52:14 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2726e7-07bb-4fa4-a60b-8160df499ef1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:14 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f Nov 02 09:52:14 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:14 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" returned: 0 in 0.445s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:15 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36 Nov 02 09:52:15 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:15 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" returned: 0 in 0.508s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:15 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f Nov 02 09:52:15 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:15 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" returned: 0 in 0.317s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-ac0c630a-5473-49aa-9d7f-4a7dee6edf36" released by "delete_volume" :: held 0.827s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Created reservations ['e78aaed9-c28d-4fc8-b3b0-acdafc0e3985', 'b6188fe5-5c7f-42cd-a146-dd92c8c92f6e', 'af5277b3-1e3c-467f-b71f-264fa790d040', '6480e925-50cc-42b3-a72f-f0247e809ff2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:15 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:15 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (32d81d7b-dfae-493e-b64e-0fae4729fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032283a2-f793-4aa9-974d-7cb1211fe721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:15 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032283a2-f793-4aa9-974d-7cb1211fe721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257181197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0feb423-3391-4c3e-91e1-13766bb16658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:16Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae63902-0175-46c5-8bf7-6e8e6fc3444a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae63902-0175-46c5-8bf7-6e8e6fc3444a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3877dead-1100-4580-bd65-fe14e33cfd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3877dead-1100-4580-bd65-fe14e33cfd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0feb423-3391-4c3e-91e1-13766bb16658', 'volume_name': 'volume-b0feb423-3391-4c3e-91e1-13766bb16658', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f84d44-be8c-40cb-85fd-05c544082158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f84d44-be8c-40cb-85fd-05c544082158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9940ebb-2e63-45f2-882a-86633aabcee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:15 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Volume b0feb423-3391-4c3e-91e1-13766bb16658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0feb423-3391-4c3e-91e1-13766bb16658', 'volume_size': 1} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257181197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0feb423-3391-4c3e-91e1-13766bb16658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:16Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Creating volume b0feb423-3391-4c3e-91e1-13766bb16658 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:15 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" returned: 0 in 0.489s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:15 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 1073741824 Nov 02 09:52:15 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-quobyte-63de2a62-d4af-4ca2-81cc-c6b223fefa7f" released by "delete_volume" :: held 1.071s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Created reservations ['78e4649e-2065-432d-a08c-b254357cc549', '888a633f-dbe8-4a60-9860-13dc0125130d', 'd4f415c2-a840-4572-ae4b-d7b2afaa74b6', '27f89043-efd7-4c80-bf1c-ddf1effdc3fe'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:16 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:16 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:16 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.596s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Deleted volume successfully. Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2994970-8713-4766-9812-2e65ebdc3ebe tempest-VolumesActionsTest-995848030 None] Lock "cinder-ac0c630a-5473-49aa-9d7f-4a7dee6edf36-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:16 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.436s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Deleted volume successfully. Nov 02 09:52:16 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 1073741824" returned: 0 in 0.764s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50c2be81-2fbe-436e-8db1-cca880138caf tempest-CreateVolumesFromSourceVolumeTest-332456094 None] Lock "cinder-63de2a62-d4af-4ca2-81cc-c6b223fefa7f-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:16 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 Nov 02 09:52:16 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (9fc75f90-e15e-4977-8abe-703b14f07a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c820984-8b0d-456b-b565-6bbb261b649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c820984-8b0d-456b-b565-6bbb261b649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339189758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5666dc-90d8-4b7d-8a15-6ef7353ae742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94baa71a-b9ed-49b0-913d-403994c8feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94baa71a-b9ed-49b0-913d-403994c8feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f18f41-85fa-424d-9c99-b054a7059aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f18f41-85fa-424d-9c99-b054a7059aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5666dc-90d8-4b7d-8a15-6ef7353ae742', 'volume_name': 'volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b732a-fa79-475a-b3da-2e0784682200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126b732a-fa79-475a-b3da-2e0784682200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab191d09-55fa-4669-b6e6-ee07204d0c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:16 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Volume 1e5666dc-90d8-4b7d-8a15-6ef7353ae742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742', 'volume_size': 1} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:16 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658" returned: 0 in 0.356s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339189758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5666dc-90d8-4b7d-8a15-6ef7353ae742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Creating volume 1e5666dc-90d8-4b7d-8a15-6ef7353ae742 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:16 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:17 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 1073741824 Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9940ebb-2e63-45f2-882a-86633aabcee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0feb423-3391-4c3e-91e1-13766bb16658', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f77e58a-8399-4719-b69a-540975fb7f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Volume volume-b0feb423-3391-4c3e-91e1-13766bb16658 (b0feb423-3391-4c3e-91e1-13766bb16658): created successfully Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f77e58a-8399-4719-b69a-540975fb7f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (32d81d7b-dfae-493e-b64e-0fae4729fda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (745a7624-b169-4e3b-9ad4-1aebc08bc3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9131288-11ad-496b-ac11-27bd1caa4480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f6efc4d5-a645-4bc6-8cdf-44655500c035 tempest-CreateVolumesFromImageTest-1038018279 None] Created volume successfully. Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9131288-11ad-496b-ac11-27bd1caa4480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531fabb0-775b-4867-aac6-7896eebf26a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96edb70-84d4-4e1b-8286-e551312c4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96edb70-84d4-4e1b-8286-e551312c4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16df344a-3bdc-4c01-b74c-03c9c40b4092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16df344a-3bdc-4c01-b74c-03c9c40b4092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531fabb0-775b-4867-aac6-7896eebf26a3', 'volume_name': 'volume-531fabb0-775b-4867-aac6-7896eebf26a3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8722a2e3-94ef-4992-8409-9826a74912da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8722a2e3-94ef-4992-8409-9826a74912da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28642ec-87ac-47e0-bc3e-cf61373163ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Volume 531fabb0-775b-4867-aac6-7896eebf26a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531fabb0-775b-4867-aac6-7896eebf26a3', 'volume_size': 1} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (556ad7f6-4f5a-42ac-b61b-aef73c4a3a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef6cf39-05cb-45fc-9a07-56ba9be5bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef6cf39-05cb-45fc-9a07-56ba9be5bc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004684561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241a8329-92b8-4233-af52-3bbdbcafeafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be00e63-06c6-45a9-b923-895c274ccb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be00e63-06c6-45a9-b923-895c274ccb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e560c5d5-6acf-49e2-8226-78603e9c5043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e560c5d5-6acf-49e2-8226-78603e9c5043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241a8329-92b8-4233-af52-3bbdbcafeafc', 'volume_name': 'volume-241a8329-92b8-4233-af52-3bbdbcafeafc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd1ad14-a528-438f-9352-3813109e6e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd1ad14-a528-438f-9352-3813109e6e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e903d674-0573-4350-9313-4b4fcd61dcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Volume 241a8329-92b8-4233-af52-3bbdbcafeafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241a8329-92b8-4233-af52-3bbdbcafeafc', 'volume_size': 1} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (f2e742a1-37eb-4b76-a1df-5434c97e5e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:17 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f90f1ad-8266-47ca-aeb1-431c4243cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 1073741824" returned: 0 in 0.786s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f90f1ad-8266-47ca-aeb1-431c4243cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038524216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cb17c0-60dc-4475-9930-b936d2b9944a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:18Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae8ceb8-7859-415c-9ed1-032e1a1437ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae8ceb8-7859-415c-9ed1-032e1a1437ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d99b6f-9296-45de-b6bf-51d7713b0065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d99b6f-9296-45de-b6bf-51d7713b0065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cb17c0-60dc-4475-9930-b936d2b9944a', 'volume_name': 'volume-23cb17c0-60dc-4475-9930-b936d2b9944a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c2264-365c-4c55-a9cf-5410e731375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0c2264-365c-4c55-a9cf-5410e731375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8158a4f-2adc-4e84-8e7a-99838d7e10ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Volume 23cb17c0-60dc-4475-9930-b936d2b9944a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cb17c0-60dc-4475-9930-b936d2b9944a', 'volume_size': 1} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:17 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 Nov 02 09:52:17 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:18 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1312766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531fabb0-775b-4867-aac6-7896eebf26a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Creating volume 531fabb0-775b-4867-aac6-7896eebf26a3 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:18 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:18 devstack sudo[103694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 1073741824 Nov 02 09:52:18 devstack sudo[103694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab191d09-55fa-4669-b6e6-ee07204d0c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d3e77-549a-4e93-b8cc-5cf051c2e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (f7c740d6-18be-4172-af70-8a9ea07bc578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811ff02d-e847-4a8c-ad8d-280a600e0a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Volume volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 (1e5666dc-90d8-4b7d-8a15-6ef7353ae742): created successfully Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d3e77-549a-4e93-b8cc-5cf051c2e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (9fc75f90-e15e-4977-8abe-703b14f07a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811ff02d-e847-4a8c-ad8d-280a600e0a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114272447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d36ca8-d481-4f60-9fcc-c7d0a09182bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:18Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17292c3-ea57-41af-9316-f9267c82e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17292c3-ea57-41af-9316-f9267c82e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b62a80-7aac-487e-9fb5-4cd99154a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b62a80-7aac-487e-9fb5-4cd99154a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45d36ca8-d481-4f60-9fcc-c7d0a09182bc', 'volume_name': 'volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7d702-b0e6-4a26-8fba-8f9ca29c7c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f7d702-b0e6-4a26-8fba-8f9ca29c7c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3ea6b-bf23-49be-a701-1cd3e75267ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Volume 45d36ca8-d481-4f60-9fcc-c7d0a09182bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc', 'volume_size': 1} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8b2e63b9-edb7-4876-a54f-302581b85eaa tempest-CreateVolumesFromImageTest-1038018279 None] Created volume successfully. Nov 02 09:52:18 devstack sudo[103694]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 1073741824" returned: 0 in 0.603s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:18 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 Nov 02 09:52:18 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:19 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1004684561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241a8329-92b8-4233-af52-3bbdbcafeafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:17Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Creating volume 241a8329-92b8-4233-af52-3bbdbcafeafc {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:19 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28642ec-87ac-47e0-bc3e-cf61373163ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531fabb0-775b-4867-aac6-7896eebf26a3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:19 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc 1073741824 Nov 02 09:52:19 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138738f7-e949-482b-b943-f306a6be1e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Volume volume-531fabb0-775b-4867-aac6-7896eebf26a3 (531fabb0-775b-4867-aac6-7896eebf26a3): created successfully Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138738f7-e949-482b-b943-f306a6be1e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (745a7624-b169-4e3b-9ad4-1aebc08bc3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a27d16e3-0ea3-4261-9572-39158e28a97c tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:52:19 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc 1073741824" returned: 0 in 0.539s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:19 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc Nov 02 09:52:19 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-531fabb0-775b-4867-aac6-7896eebf26a3-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "cinder-531fabb0-775b-4867-aac6-7896eebf26a3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Acquiring lock "cinder-quobyte-531fabb0-775b-4867-aac6-7896eebf26a3" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-531fabb0-775b-4867-aac6-7896eebf26a3" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c01945-9e8f-4e77-b1c0-e351dd868898]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:20 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc" returned: 0 in 0.465s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1038524216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cb17c0-60dc-4475-9930-b936d2b9944a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:18Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Creating volume 23cb17c0-60dc-4475-9930-b936d2b9944a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:20 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e903d674-0573-4350-9313-4b4fcd61dcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241a8329-92b8-4233-af52-3bbdbcafeafc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:20 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a 1073741824 Nov 02 09:52:20 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b99ea9-879b-4927-a6f0-41d7a7722623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:20 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Volume volume-241a8329-92b8-4233-af52-3bbdbcafeafc (241a8329-92b8-4233-af52-3bbdbcafeafc): created successfully Nov 02 09:52:20 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 Nov 02 09:52:20 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b99ea9-879b-4927-a6f0-41d7a7722623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (556ad7f6-4f5a-42ac-b61b-aef73c4a3a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:20 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cfff5b1e-013a-42d7-a59c-faf0c9f219d5 tempest-CreateVolumesFromImageTest-1038018279 None] Created volume successfully. Nov 02 09:52:20 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3" returned: 0 in 0.485s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:20 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3 Nov 02 09:52:20 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:21 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a 1073741824" returned: 0 in 0.706s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:21 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-531fabb0-775b-4867-aac6-7896eebf26a3" returned: 0 in 0.356s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "cinder-quobyte-531fabb0-775b-4867-aac6-7896eebf26a3" released by "delete_volume" :: held 0.922s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:21 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a Nov 02 09:52:21 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Created reservations ['a9ca4049-ffda-453c-9161-8622d5e23508', '65ccaba3-d21e-4c24-a827-dad23bdfe6ae', 'f9b28149-47cd-40b8-81d6-5284dadf68cc', 'f99be75d-40ed-441c-98ae-cb8af07906ec'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:21 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:21 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Flow 'volume_create_manager' (37eb000c-d4d5-49da-8a97-f9dac834337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c52d68-fbbd-46d4-a751-3dcd9c2e59d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c52d68-fbbd-46d4-a751-3dcd9c2e59d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-502071892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26f51f8-47df-48b0-a36e-20c6aba88dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ceb334b6b94178869b7a2992a7f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:21Z,use_quota=True,user_id='fc6e890eaf3d4d24bf11348163299ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da31a5b-677c-450e-b64e-bad2ebd316fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da31a5b-677c-450e-b64e-bad2ebd316fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b585ba-72e9-45dc-941a-7b8a3a94e094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b585ba-72e9-45dc-941a-7b8a3a94e094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26f51f8-47df-48b0-a36e-20c6aba88dc6', 'volume_name': 'volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afd1386-32ce-413b-94d1-926a9af89dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afd1386-32ce-413b-94d1-926a9af89dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa058b0-c458-4608-b12c-dc1d1bf1538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Volume d26f51f8-47df-48b0-a36e-20c6aba88dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6', 'volume_size': 1} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:21 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a" returned: 0 in 0.408s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114272447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d36ca8-d481-4f60-9fcc-c7d0a09182bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5741e0df7d940e79b6643a12fa7d938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:18Z,use_quota=True,user_id='8b766908cc55413f99f4a86a646dffc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Creating volume 45d36ca8-d481-4f60-9fcc-c7d0a09182bc {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:21 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:21 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc 1073741824 Nov 02 09:52:21 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8158a4f-2adc-4e84-8e7a-99838d7e10ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cb17c0-60dc-4475-9930-b936d2b9944a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587e2fe7-96f1-490f-9d0e-b9d0d27dfdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:21 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Volume volume-23cb17c0-60dc-4475-9930-b936d2b9944a (23cb17c0-60dc-4475-9930-b936d2b9944a): created successfully Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587e2fe7-96f1-490f-9d0e-b9d0d27dfdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (f2e742a1-37eb-4b76-a1df-5434c97e5e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-80d4ff6b-adee-4581-a207-2425d6757b79 tempest-CreateVolumesFromImageTest-1038018279 None] Created volume successfully. Nov 02 09:52:21 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.397s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Deleted volume successfully. Nov 02 09:52:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ecf230b5-8485-4813-afbc-08cd27d04398 tempest-VolumesActionsTest-995848030 None] Lock "cinder-531fabb0-775b-4867-aac6-7896eebf26a3-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (23606952-a223-4b2a-bd6a-4c4f2f7aa189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d651b5-f633-4c18-9315-f2f82cb831f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d651b5-f633-4c18-9315-f2f82cb831f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483795616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:22Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49572df3-1933-45e1-8669-b58cc5ec352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49572df3-1933-45e1-8669-b58cc5ec352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c61c14-3acc-4f49-aeb1-ffd4a3f92683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c61c14-3acc-4f49-aeb1-ffd4a3f92683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4', 'volume_name': 'volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6794028-ef36-473d-8795-f6427084c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6794028-ef36-473d-8795-f6427084c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734c8989-4554-4811-a197-bb5d70324b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Volume ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4', 'volume_size': 1} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc 1073741824" returned: 0 in 0.668s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:22 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc Nov 02 09:52:22 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:22 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" returned: 0 in 0.306s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-502071892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26f51f8-47df-48b0-a36e-20c6aba88dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ceb334b6b94178869b7a2992a7f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:21Z,use_quota=True,user_id='fc6e890eaf3d4d24bf11348163299ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Creating volume d26f51f8-47df-48b0-a36e-20c6aba88dc6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:22 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:22 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 1073741824 Nov 02 09:52:22 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb3ea6b-bf23-49be-a701-1cd3e75267ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b80b88-164a-4a0f-8ac8-030f96588a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:22 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Volume volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc (45d36ca8-d481-4f60-9fcc-c7d0a09182bc): created successfully Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b80b88-164a-4a0f-8ac8-030f96588a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Flow 'volume_create_manager' (f7c740d6-18be-4172-af70-8a9ea07bc578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9880b193-ca3d-4135-974a-7ab40f6c84b8 tempest-CreateVolumesFromImageTest-1038018279 None] Created volume successfully. Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-45d36ca8-d481-4f60-9fcc-c7d0a09182bc-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-45d36ca8-d481-4f60-9fcc-c7d0a09182bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-quobyte-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddd0ec0-2385-41e2-b9c1-c6ba6fc2eb6c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc Nov 02 09:52:23 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:23 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 1073741824" returned: 0 in 0.665s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 Nov 02 09:52:23 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:23 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc Nov 02 09:52:23 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:23 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6" returned: 0 in 0.330s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483795616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36f35406c40442b39a7e4243054e9723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:22Z,use_quota=True,user_id='a5e575bfd84448708a49e32478b4fd15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Creating volume ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:23 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 1073741824 Nov 02 09:52:23 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa058b0-c458-4608-b12c-dc1d1bf1538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e74585-0e85-40cc-bb10-c542c2a04522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Volume volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 (d26f51f8-47df-48b0-a36e-20c6aba88dc6): created successfully Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e74585-0e85-40cc-bb10-c542c2a04522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Flow 'volume_create_manager' (37eb000c-d4d5-49da-8a97-f9dac834337a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8ac0c20f-c628-41ac-b9e5-793f4d38260b tempest-ProjectReaderTests-671697915 None] Created volume successfully. Nov 02 09:52:23 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" returned: 0 in 0.300s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-45d36ca8-d481-4f60-9fcc-c7d0a09182bc" released by "delete_volume" :: held 0.853s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:23 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Created reservations ['15e53a68-384b-4a6c-8744-862ad387da2f', '458a3190-85c9-474f-b6c4-bac94b398602', '2f2a3d95-8a88-48bc-a96c-50f0ccc0a9d7', 'c69a6802-ec14-482c-9a97-c0ccc3926ab0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:24 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-23cb17c0-60dc-4475-9930-b936d2b9944a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-23cb17c0-60dc-4475-9930-b936d2b9944a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-quobyte-23cb17c0-60dc-4475-9930-b936d2b9944a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-23cb17c0-60dc-4475-9930-b936d2b9944a" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa38e61-d28a-4a88-90d0-ad0b6e9d15ba]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 1073741824" returned: 0 in 0.744s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 Nov 02 09:52:24 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a Nov 02 09:52:24 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Deleted volume successfully. Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-52349754-c02d-418d-9c05-a1f2f4b1151a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-45d36ca8-d481-4f60-9fcc-c7d0a09182bc-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:24 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734c8989-4554-4811-a197-bb5d70324b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00f41ec-b6c6-4e27-8000-e3ffb2873863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Acquiring lock "cinder-d26f51f8-47df-48b0-a36e-20c6aba88dc6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:24 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Volume volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 (ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4): created successfully Nov 02 09:52:24 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00f41ec-b6c6-4e27-8000-e3ffb2873863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Flow 'volume_create_manager' (23606952-a223-4b2a-bd6a-4c4f2f7aa189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a" returned: 0 in 0.525s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "cinder-d26f51f8-47df-48b0-a36e-20c6aba88dc6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-17d60006-e9be-40a7-8dae-72c9d8130efd tempest-VolumesActionsTest-1249731556 None] Created volume successfully. Nov 02 09:52:24 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a Nov 02 09:52:24 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Acquiring lock "cinder-quobyte-d26f51f8-47df-48b0-a36e-20c6aba88dc6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "cinder-quobyte-d26f51f8-47df-48b0-a36e-20c6aba88dc6" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c298453-bcb2-4f84-aa65-6d17813d55a7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:25 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 Nov 02 09:52:25 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:25 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23cb17c0-60dc-4475-9930-b936d2b9944a" returned: 0 in 0.327s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-23cb17c0-60dc-4475-9930-b936d2b9944a" released by "delete_volume" :: held 0.919s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Created reservations ['2c28fd05-e020-4316-b9b4-960f758bcb02', '1fe86d0f-f2fb-4471-85ab-cf51404a08e4', 'f6c8999a-0317-4e23-b653-12c70981cd73', '59df443c-304b-4fd0-b729-73879f5c21ee'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:25 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:25 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:25 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6" returned: 0 in 0.454s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:25 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6 Nov 02 09:52:25 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:25 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Deleted volume successfully. Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be267f2d-83e4-4c09-bb24-851634599253 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-23cb17c0-60dc-4475-9930-b936d2b9944a-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:25 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d26f51f8-47df-48b0-a36e-20c6aba88dc6" returned: 0 in 0.318s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "cinder-quobyte-d26f51f8-47df-48b0-a36e-20c6aba88dc6" released by "delete_volume" :: held 0.824s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Created reservations ['0d37ff25-f000-44a9-abda-c817328c4a4a', '52d2d136-3174-40d7-bac0-1c60ca1932da', 'c873a11f-3011-40f9-86c8-e7ca9c36e037', '121f4024-6baa-45ce-bd6b-95fefc78ebb7'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:26 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "cinder-quobyte-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-quobyte-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9145896b-1c8b-445d-a894-d209cc8dc6f5]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Deleted volume successfully. Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6c8819ef-1416-4f0c-8cc7-93d8f26dae39 tempest-ProjectReaderTests-671697915 None] Lock "cinder-d26f51f8-47df-48b0-a36e-20c6aba88dc6-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:26 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 Nov 02 09:52:26 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-241a8329-92b8-4233-af52-3bbdbcafeafc-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-241a8329-92b8-4233-af52-3bbdbcafeafc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-quobyte-241a8329-92b8-4233-af52-3bbdbcafeafc" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-241a8329-92b8-4233-af52-3bbdbcafeafc" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Flow 'volume_create_manager' (b8da59b6-27e7-40ae-97be-b86a4c59ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c03adb9-5777-46f3-b982-c86a8c668d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db5c6d-839a-4205-bc19-d6b5b2fc5cb6]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c03adb9-5777-46f3-b982-c86a8c668d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421585232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb86200-5951-4f2f-9cdf-8f3efd94094d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ceb334b6b94178869b7a2992a7f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:27Z,use_quota=True,user_id='fc6e890eaf3d4d24bf11348163299ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:26 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c381782b-2d99-4f90-b5e3-2de46b1e6b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c381782b-2d99-4f90-b5e3-2de46b1e6b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7eda1f-3737-4685-bce9-4ba3ef3af92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7eda1f-3737-4685-bce9-4ba3ef3af92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb86200-5951-4f2f-9cdf-8f3efd94094d', 'volume_name': 'volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e7c2d0-5f58-42c8-a5da-569e83fd9869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e7c2d0-5f58-42c8-a5da-569e83fd9869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4b299a-cebc-4bed-9120-2f88db8196c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:26 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Volume 4bb86200-5951-4f2f-9cdf-8f3efd94094d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d', 'volume_size': 1} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421585232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb86200-5951-4f2f-9cdf-8f3efd94094d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ceb334b6b94178869b7a2992a7f2ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:27Z,use_quota=True,user_id='fc6e890eaf3d4d24bf11348163299ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Creating volume 4bb86200-5951-4f2f-9cdf-8f3efd94094d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:26 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" returned: 0 in 0.517s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:26 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d 1073741824 Nov 02 09:52:26 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4 Nov 02 09:52:26 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:26 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc Nov 02 09:52:26 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc Nov 02 09:52:27 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-quobyte-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4" released by "delete_volume" :: held 0.950s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Created reservations ['61276e35-0f8e-4d44-bf17-e7bc65f2046e', '02d6204f-62f1-4971-a70a-9130995d2236', '5c36a3b4-835b-455d-b06a-cb3c572f5402', '06e609b2-5128-4226-aad5-3f54353e8a4e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:27 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d 1073741824" returned: 0 in 0.641s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-241a8329-92b8-4233-af52-3bbdbcafeafc" returned: 0 in 0.368s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d Nov 02 09:52:27 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-241a8329-92b8-4233-af52-3bbdbcafeafc" released by "delete_volume" :: held 0.885s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Created reservations ['c81c42c0-b350-43fb-b98e-741b92cd3d15', '591de62f-b6aa-4ff2-9402-abb56c346506', 'db313a8d-932f-4708-a68d-d788cba7bfe0', '43c95eb8-2aec-4a5c-b914-00ff85a38ab8'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:27 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.332s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Deleted volume successfully. Nov 02 09:52:27 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:27 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4e86a064-ff95-4ddc-bea7-36a2114de346 tempest-VolumesActionsTest-1249731556 None] Lock "cinder-ba03c8af-d25a-41f8-8fe1-28cd0f4f9ef4-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:27 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4b299a-cebc-4bed-9120-2f88db8196c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862e67c-3798-48fb-a667-165bf8b317a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:27 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Volume volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d (4bb86200-5951-4f2f-9cdf-8f3efd94094d): created successfully Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862e67c-3798-48fb-a667-165bf8b317a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Flow 'volume_create_manager' (b8da59b6-27e7-40ae-97be-b86a4c59ab31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f141acfe-d82f-4f1f-b648-85ed8e3da1e6 tempest-ProjectReaderTests-671697915 None] Created volume successfully. Nov 02 09:52:28 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Deleted volume successfully. Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3130a205-7476-4051-a317-09d42898c94a tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-241a8329-92b8-4233-af52-3bbdbcafeafc-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-1e5666dc-90d8-4b7d-8a15-6ef7353ae742-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Acquiring lock "cinder-4bb86200-5951-4f2f-9cdf-8f3efd94094d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-1e5666dc-90d8-4b7d-8a15-6ef7353ae742-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "cinder-4bb86200-5951-4f2f-9cdf-8f3efd94094d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=181,cinder:INSERT=62,cinder:UPDATE=264,cinder:DELETE=20 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:28 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:INSERT=63,cinder:UPDATE=265,cinder:SELECT=185,cinder:DELETE=23 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Acquiring lock "cinder-quobyte-4bb86200-5951-4f2f-9cdf-8f3efd94094d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-quobyte-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" acquired by "delete_volume" :: waited 0.041s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "cinder-quobyte-4bb86200-5951-4f2f-9cdf-8f3efd94094d" acquired by "delete_volume" :: waited 0.091s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af8073-c31a-4c39-ad17-b1286b917db8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2fa1cf-17e0-44cc-8164-ec7b9708b5f0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 Nov 02 09:52:29 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d Nov 02 09:52:29 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d" returned: 0 in 0.530s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" returned: 0 in 0.588s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:29 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d Nov 02 09:52:29 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:29 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742 Nov 02 09:52:29 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-1e5666dc-90d8-4b7d-8a15-6ef7353ae742" released by "delete_volume" :: held 1.052s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4bb86200-5951-4f2f-9cdf-8f3efd94094d" returned: 0 in 0.435s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "cinder-quobyte-4bb86200-5951-4f2f-9cdf-8f3efd94094d" released by "delete_volume" :: held 1.036s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Created reservations ['af5c8b2f-f19d-437a-bef2-c6fc818bd59b', '3966ea65-c830-4923-ba34-fb1ddbb96844', '8227f1e0-85e5-4f36-b0ef-a2c67fc8bd48', '01132ef8-9cb3-442e-abf1-ea5f8f7c498f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Created reservations ['b1b7aae7-65ba-410b-85b5-3458bb32458b', '4acaede8-a8e5-4f76-a36d-d8bb4244071e', '7e839b99-fdfc-4411-b20b-cba613016c83', '4a4024c4-d4a4-4d9a-9fba-7f6d2e804c07'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:30 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:30 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:30 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:30 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Deleted volume successfully. Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-04cdcecf-adbb-4b01-acb9-88118684a072 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-1e5666dc-90d8-4b7d-8a15-6ef7353ae742-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:30 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Deleted volume successfully. Nov 02 09:52:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a88fb1d9-d09c-4b58-8f56-6c65aa6e6109 tempest-ProjectReaderTests-671697915 None] Lock "cinder-4bb86200-5951-4f2f-9cdf-8f3efd94094d-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-b0feb423-3391-4c3e-91e1-13766bb16658-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-b0feb423-3391-4c3e-91e1-13766bb16658-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "cinder-quobyte-b0feb423-3391-4c3e-91e1-13766bb16658" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-b0feb423-3391-4c3e-91e1-13766bb16658" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79f515-4e5d-48a1-9594-254969fedac4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 Nov 02 09:52:31 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:31 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658" returned: 0 in 0.495s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:31 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658 Nov 02 09:52:31 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0feb423-3391-4c3e-91e1-13766bb16658" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-quobyte-b0feb423-3391-4c3e-91e1-13766bb16658" released by "delete_volume" :: held 0.963s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Created reservations ['43e5e7ff-ce8f-47e7-bda0-f861c76849e9', 'b1cf70cc-ee98-460f-b11a-30c170ba97aa', 'afabc1bc-a8dc-4239-a958-a08c40c83797', 'a27c7db3-85a1-4b6a-a417-87aeafaa3e43'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:32 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:32 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:32 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.292s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Deleted volume successfully. Nov 02 09:52:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4b04d1c7-748b-44c0-89ec-8e65fc880656 tempest-CreateVolumesFromImageTest-1038018279 None] Lock "cinder-b0feb423-3391-4c3e-91e1-13766bb16658-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Flow 'volume_create_manager' (25d3a828-4e94-46a3-993d-3228f6190fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76259d3a-b538-4863-8d8a-fb892b97f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76259d3a-b538-4863-8d8a-fb892b97f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e0a473-06ed-4693-999e-4e2ba8a5c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4d1aa340ef47868660b603f2c2482d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:40Z,use_quota=True,user_id='b29f8060cdf24d9a892d228414f1138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ef1b39-2e6f-44a3-bf97-9585eadced39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ef1b39-2e6f-44a3-bf97-9585eadced39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044be801-922b-42b5-9596-2c60ef528019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:40 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (044be801-922b-42b5-9596-2c60ef528019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01e0a473-06ed-4693-999e-4e2ba8a5c00f', 'volume_name': 'volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f', 'volume_size': 1, 'image_id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0ef5ffca0313a987746b56f040ce0de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d4d1aa340ef47868660b603f2c2482d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b681daa0eddbb308d650796c95496f1815acdb774677159aaa24eb1807c0c1fc7370263cca8668cb7293f1816f10e323881d263dd1bdc01aecdf5b6c20dbbd6', 'id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9061a7-866f-4c5e-80a6-9c55557f2616/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f89b45-1f60-4405-a68d-a66ccf138d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f89b45-1f60-4405-a68d-a66ccf138d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7985dd3-96a2-4462-a0bf-885f2d9b8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:41 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f', 'volume_size': 1, 'image_id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0ef5ffca0313a987746b56f040ce0de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d4d1aa340ef47868660b603f2c2482d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b681daa0eddbb308d650796c95496f1815acdb774677159aaa24eb1807c0c1fc7370263cca8668cb7293f1816f10e323881d263dd1bdc01aecdf5b6c20dbbd6', 'id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9061a7-866f-4c5e-80a6-9c55557f2616/file', 'properties': {}}, 'image_service': } Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Trying to clone 01e0a473-06ed-4693-999e-4e2ba8a5c00f from image db9061a7-866f-4c5e-80a6-9c55557f2616 at location (None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:52:41 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Image download 0.00 MB at 0.00 MB/s Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[96df0dc5-a19e-4385-9d5f-9555a38d2069]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:41 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:41 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:41 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:41 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:41 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:42 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Temporary image db9061a7-866f-4c5e-80a6-9c55557f2616 is fetched for user b29f8060cdf24d9a892d228414f1138d. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fe36aa-487e-47cd-af63-3cae939ec706]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:42 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:42 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:42 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:42 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:42 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:42 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e0a473-06ed-4693-999e-4e2ba8a5c00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4d1aa340ef47868660b603f2c2482d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:40Z,use_quota=True,user_id='b29f8060cdf24d9a892d228414f1138d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Creating volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:42 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:42 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1073741824 Nov 02 09:52:42 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:43 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1073741824" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:43 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f Nov 02 09:52:43 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:43 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f" returned: 0 in 0.253s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Attempting download of db9061a7-866f-4c5e-80a6-9c55557f2616 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}])) to volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b1bba1-fe34-464e-ad4b-23216dab3b00]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:43 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q Nov 02 09:52:43 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:44 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:44 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q Nov 02 09:52:44 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:44 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q" returned: 1 in 0.337s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_db9061a7-866f-4c5e-80a6-9c55557f2616_wdgx4_9q' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa5410-1895-4391-b8f2-a57aab7dfed5]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:44 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:44 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:44 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:44 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD Nov 02 09:52:44 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:45 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] db9061a7-866f-4c5e-80a6-9c55557f2616 was raw, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:45 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f Nov 02 09:52:45 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:45 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f" returned: 0 in 0.516s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_db9061a7-866f-4c5e-80a6-9c55557f2616_rb1z3g5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:52:45 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:45 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1G Nov 02 09:52:45 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:45 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f 1G" returned: 0 in 0.347s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Downloaded image db9061a7-866f-4c5e-80a6-9c55557f2616 ((None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}])) to volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Temporary image db9061a7-866f-4c5e-80a6-9c55557f2616 for user b29f8060cdf24d9a892d228414f1138d is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:52:45 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Marking volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Copying metadata from image db9061a7-866f-4c5e-80a6-9c55557f2616 to 01e0a473-06ed-4693-999e-4e2ba8a5c00f. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Creating volume glance metadata for volume 01e0a473-06ed-4693-999e-4e2ba8a5c00f backed by image db9061a7-866f-4c5e-80a6-9c55557f2616 with: {'image_id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b0ef5ffca0313a987746b56f040ce0de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7985dd3-96a2-4462-a0bf-885f2d9b8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f', 'volume_size': 1, 'image_id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/db9061a7-866f-4c5e-80a6-9c55557f2616', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0ef5ffca0313a987746b56f040ce0de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d4d1aa340ef47868660b603f2c2482d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b681daa0eddbb308d650796c95496f1815acdb774677159aaa24eb1807c0c1fc7370263cca8668cb7293f1816f10e323881d263dd1bdc01aecdf5b6c20dbbd6', 'id': 'db9061a7-866f-4c5e-80a6-9c55557f2616', 'created_at': datetime.datetime(2026, 11, 2, 8, 52, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 52, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/db9061a7-866f-4c5e-80a6-9c55557f2616/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426227f5-4d83-49e4-982a-3d806f647c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Volume volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f (01e0a473-06ed-4693-999e-4e2ba8a5c00f): created successfully Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426227f5-4d83-49e4-982a-3d806f647c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Flow 'volume_create_manager' (25d3a828-4e94-46a3-993d-3228f6190fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-72b9c32f-b335-4262-82ae-77c75fef5212 tempest-VolumeImageDependencyTests-352362812 None] Created volume successfully. Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Acquiring lock "cinder-01e0a473-06ed-4693-999e-4e2ba8a5c00f-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "cinder-01e0a473-06ed-4693-999e-4e2ba8a5c00f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Acquiring lock "cinder-quobyte-01e0a473-06ed-4693-999e-4e2ba8a5c00f" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "cinder-quobyte-01e0a473-06ed-4693-999e-4e2ba8a5c00f" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[67156396-0e4e-4a62-90bc-570915fe8b92]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:47 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f Nov 02 09:52:47 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:47 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f" returned: 0 in 0.400s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:47 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f Nov 02 09:52:47 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:47 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01e0a473-06ed-4693-999e-4e2ba8a5c00f" returned: 0 in 0.260s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "cinder-quobyte-01e0a473-06ed-4693-999e-4e2ba8a5c00f" released by "delete_volume" :: held 0.721s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Created reservations ['51a7f393-da60-4b1e-8805-4e432e4bfd9c', 'a405df70-e0a8-46d9-8515-962b632d0747', 'fc47ee16-0774-44f7-9fd7-bda8854c6d5a', '968dce1c-79b5-4ab0-b698-e64ad066054c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:47 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:47 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Flow 'volume_create_manager' (4f883fc2-9b58-4091-8566-9077a328d597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485f04d-8dcc-47c4-b487-4fe2f17e64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0485f04d-8dcc-47c4-b487-4fe2f17e64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-439794481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa40a4d7-a30c-47c7-8cc9-342a52a836a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00de59d4957446b2a9c50f8886879bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:48Z,use_quota=True,user_id='3efbcc34728640d89f8910e2ce6c3fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6af87f-db23-4161-beb9-4894c5b56381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6af87f-db23-4161-beb9-4894c5b56381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5b1d1f-2fd4-41c9-8e01-bb5fb49ab8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5b1d1f-2fd4-41c9-8e01-bb5fb49ab8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa40a4d7-a30c-47c7-8cc9-342a52a836a1', 'volume_name': 'volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb0fe25-4e68-4e7a-bcbb-ded0ad2c59c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb0fe25-4e68-4e7a-bcbb-ded0ad2c59c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8acb74b-175a-491c-ac9a-f8f71eadabce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1', 'volume_size': 1} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-439794481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa40a4d7-a30c-47c7-8cc9-342a52a836a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00de59d4957446b2a9c50f8886879bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:48Z,use_quota=True,user_id='3efbcc34728640d89f8910e2ce6c3fff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Creating volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:48 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:48 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 1073741824 Nov 02 09:52:48 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:48 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.299s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Deleted volume successfully. Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ab0b48da-6823-4312-8af5-0d4536da0009 tempest-VolumeImageDependencyTests-352362812 None] Lock "cinder-01e0a473-06ed-4693-999e-4e2ba8a5c00f-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:52:48 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 1073741824" returned: 0 in 0.571s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:48 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 Nov 02 09:52:48 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:48 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8acb74b-175a-491c-ac9a-f8f71eadabce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d521287f-e086-4d3b-a384-d96bd669a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:49 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Volume volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 (fa40a4d7-a30c-47c7-8cc9-342a52a836a1): created successfully Nov 02 09:52:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d521287f-e086-4d3b-a384-d96bd669a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Flow 'volume_create_manager' (4f883fc2-9b58-4091-8566-9077a328d597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9396dad7-4c93-4987-89d6-2b959731fa5e tempest-VolumesSnapshotListTestJSON-586458197 None] Created volume successfully. Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Creating offline snapshot 53fcb438-50e9-4c5a-9004-6340c51cd2cc of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ac2e7-93cd-4d72-8948-482b30e42005]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:50 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 Nov 02 09:52:50 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:50 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" returned: 0 in 0.391s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:50 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc 1G Nov 02 09:52:50 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:51 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc 1G" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:51 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:52:51 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:51 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Flow 'volume_create_manager' (0ce2c97e-3e5c-4714-9553-ce4ccdd9f99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fe85db-9223-47df-8453-6cd1d3499166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:51 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc is being set with open permissions: ugo+rw Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3fe85db-9223-47df-8453-6cd1d3499166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eccfe92-cfb6-4a68-9bbe-f75f78467283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ba1c2d8aac4d8a8c3557ccec92b649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:51Z,use_quota=True,user_id='db3ed2ef15cf4d988e65df2594c82022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:51 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:52:51 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbae841-9abe-4660-ba06-39a9ce7bf474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbae841-9abe-4660-ba06-39a9ce7bf474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2cf382-ad96-422f-acd5-be1cc39d7fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b2cf382-ad96-422f-acd5-be1cc39d7fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eccfe92-cfb6-4a68-9bbe-f75f78467283', 'volume_name': 'volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544142f5-5b4a-4b15-ab60-9f10a20b94a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544142f5-5b4a-4b15-ab60-9f10a20b94a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7088d8a-7994-4e2f-8b76-fac3da73d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Volume 6eccfe92-cfb6-4a68-9bbe-f75f78467283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283', 'volume_size': 1} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:51 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.239s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:51 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info Nov 02 09:52:51 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:52 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info" returned: 0 in 0.242s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:52 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info is being set with open permissions: ugo+rw Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:52 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info Nov 02 09:52:52 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:52 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.info" returned: 0 in 0.246s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eccfe92-cfb6-4a68-9bbe-f75f78467283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ba1c2d8aac4d8a8c3557ccec92b649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:51Z,use_quota=True,user_id='db3ed2ef15cf4d988e65df2594c82022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Creating volume 6eccfe92-cfb6-4a68-9bbe-f75f78467283 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:52 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:52 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 1073741824 Nov 02 09:52:52 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9aff4585-b457-455b-ac38-56ef2a1ed627 tempest-VolumesSnapshotListTestJSON-586458197 None] Create snapshot completed successfully Nov 02 09:52:52 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 1073741824" returned: 0 in 0.426s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:52 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 Nov 02 09:52:52 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:53 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7088d8a-7994-4e2f-8b76-fac3da73d164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3a337c-737a-4da1-b967-ca45411a71e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:53 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Volume volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 (6eccfe92-cfb6-4a68-9bbe-f75f78467283): created successfully Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3a337c-737a-4da1-b967-ca45411a71e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Flow 'volume_create_manager' (0ce2c97e-3e5c-4714-9553-ce4ccdd9f99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ed147236-c6e1-432e-957e-fe3af434d2b5 tempest-CinderUnicodeTest-927740810 None] Created volume successfully. Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Creating offline snapshot 791f484c-c005-40b0-bfd4-972bb60a7b59 of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f63b5a3-46c8-47ff-b6e3-1cd56943f90c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:53 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:52:53 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:54 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.429s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:54 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 1G Nov 02 09:52:54 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Flow 'volume_create_manager' (a0b042d8-0662-43f6-bb1e-b9c87107d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503ca0db-b90a-4703-a671-23521623b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503ca0db-b90a-4703-a671-23521623b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1708938696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270cdc5f-461e-4529-a9e6-7ee3d88752a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ba1c2d8aac4d8a8c3557ccec92b649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:54Z,use_quota=True,user_id='db3ed2ef15cf4d988e65df2594c82022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dd0825-7127-4c2c-bb7c-e7b91a212da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4dd0825-7127-4c2c-bb7c-e7b91a212da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93de9644-6660-4a1d-a08a-9d551c316369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93de9644-6660-4a1d-a08a-9d551c316369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270cdc5f-461e-4529-a9e6-7ee3d88752a3', 'volume_name': 'volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b2256e-cb32-4ce0-9b0d-94bbe526c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b2256e-cb32-4ce0-9b0d-94bbe526c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60299348-ea31-483f-b796-d2162acab7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Volume 270cdc5f-461e-4529-a9e6-7ee3d88752a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3', 'volume_size': 1} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:54 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 1G" returned: 0 in 0.460s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:54 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:52:54 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:54 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.317s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:54 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 is being set with open permissions: ugo+rw Nov 02 09:52:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:54 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:52:54 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:55 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.253s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.581s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:52:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1708938696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270cdc5f-461e-4529-a9e6-7ee3d88752a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56ba1c2d8aac4d8a8c3557ccec92b649',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:52:54Z,use_quota=True,user_id='db3ed2ef15cf4d988e65df2594c82022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Creating volume 270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:52:55 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:55 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 1073741824 Nov 02 09:52:55 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1661787c-95b9-4359-ad7a-1987af99b583 tempest-VolumesSnapshotListTestJSON-586458197 None] Create snapshot completed successfully Nov 02 09:52:55 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 1073741824" returned: 0 in 0.448s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:55 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 Nov 02 09:52:55 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:55 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3" returned: 0 in 0.277s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.055s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60299348-ea31-483f-b796-d2162acab7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973e8416-0178-4949-8dff-3cd2c47b6a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:52:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Creating offline snapshot 33d98fa7-d343-4181-a87f-155aa609fc4b of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:52:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Volume volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 (270cdc5f-461e-4529-a9e6-7ee3d88752a3): created successfully Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973e8416-0178-4949-8dff-3cd2c47b6a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Flow 'volume_create_manager' (a0b042d8-0662-43f6-bb1e-b9c87107d943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f964119-c5c8-4f9f-aedb-f21b06aaafd4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-706ce287-9fb5-4fa1-9386-936a63aa503b tempest-CinderUnicodeTest-927740810 None] Created volume successfully. Nov 02 09:52:56 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:52:56 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:56 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.432s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:56 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b 1G Nov 02 09:52:56 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:57 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b 1G" returned: 0 in 0.549s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:57 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b Nov 02 09:52:57 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:57 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b" returned: 0 in 0.321s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:57 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b is being set with open permissions: ugo+rw Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:57 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b Nov 02 09:52:57 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:57 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b" returned: 0 in 0.285s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.711s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.096s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Creating offline snapshot e146bfde-3740-452c-8b08-3d90f3e97294 of volume 270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:52:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0cbea084-5fa6-4e93-a414-af15477c08f9 tempest-VolumesSnapshotListTestJSON-586458197 None] Create snapshot completed successfully Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cec756-3dd2-406f-b347-8554db22e48b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:57 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 Nov 02 09:52:57 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:58 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3" returned: 0 in 0.385s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:58 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 1G Nov 02 09:52:58 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:58 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:52:58 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:58 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:52:58 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 1G" returned: 0 in 0.510s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:58 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 Nov 02 09:52:58 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:58 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:58 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 is being set with open permissions: ugo+rw Nov 02 09:52:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:58 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 Nov 02 09:52:58 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-33d98fa7-d343-4181-a87f-155aa609fc4b-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-33d98fa7-d343-4181-a87f-155aa609fc4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-33d98fa7-d343-4181-a87f-155aa609fc4b" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-33d98fa7-d343-4181-a87f-155aa609fc4b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Deleting offline snapshot 33d98fa7-d343-4181-a87f-155aa609fc4b of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] snapshot_file for this snap is: volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc630ed7-a333-4c00-a898-828828c5285a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:59 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294" returned: 0 in 0.255s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:59 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info Nov 02 09:52:59 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:59 devstack sudo[104088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b Nov 02 09:52:59 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:59 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info" returned: 0 in 0.272s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:59 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info is being set with open permissions: ugo+rw Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:59 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info Nov 02 09:52:59 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:59 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b" returned: 0 in 0.380s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af5473-ea12-4528-993a-7205828230f3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:52:59 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:52:59 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:52:59 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.info" returned: 0 in 0.281s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:52:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-44a4073a-7c06-45ae-8816-b457339f62fa tempest-CinderUnicodeTest-927740810 None] Create snapshot completed successfully Nov 02 09:52:59 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.373s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:52:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:00 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b Nov 02 09:53:00 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:00 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b" returned: 0 in 0.405s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:00 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b Nov 02 09:53:00 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:00 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.33d98fa7-d343-4181-a87f-155aa609fc4b" returned: 0 in 0.241s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-33d98fa7-d343-4181-a87f-155aa609fc4b" released by "_delete_snapshot" :: held 1.510s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" released by "delete_snapshot" :: held 1.533s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Created reservations ['2b01d77b-9f5f-4802-8b0a-6f95ba24a1bd', '46cd6f45-c878-441d-be34-22dad8e8be96', 'e148067a-acc8-4266-8445-0304c83f5925', '98899fd9-3686-4bfd-89a7-5d1d8d6d03fd'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-e146bfde-3740-452c-8b08-3d90f3e97294-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Delete snapshot completed successfully. Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-e146bfde-3740-452c-8b08-3d90f3e97294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-43a23234-cea3-4da7-b0c9-38a6c4e9a082 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-33d98fa7-d343-4181-a87f-155aa609fc4b-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-quobyte-e146bfde-3740-452c-8b08-3d90f3e97294" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-e146bfde-3740-452c-8b08-3d90f3e97294" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Deleting offline snapshot e146bfde-3740-452c-8b08-3d90f3e97294 of volume 270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] snapshot_file for this snap is: volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e49cc8-1480-4ace-9556-00c6bf76983f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:00 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 Nov 02 09:53:00 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-791f484c-c005-40b0-bfd4-972bb60a7b59-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:01 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294" returned: 0 in 0.368s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-791f484c-c005-40b0-bfd4-972bb60a7b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea9ce1-293f-41f3-a312-2a181340662c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-791f484c-c005-40b0-bfd4-972bb60a7b59" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-791f484c-c005-40b0-bfd4-972bb60a7b59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Deleting offline snapshot 791f484c-c005-40b0-bfd4-972bb60a7b59 of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] snapshot_file for this snap is: volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc80d2ad-da73-49e6-83b0-fd4b9a78a30f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:01 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 Nov 02 09:53:01 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:01 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:53:01 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:01 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:01 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 Nov 02 09:53:01 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:01 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[15feaee0-9f7b-4a6e-8da5-6581a18dd87b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:01 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:53:01 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:02 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294" returned: 0 in 0.347s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:02 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294 Nov 02 09:53:02 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:02 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.385s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:02 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:53:02 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:02 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3.e146bfde-3740-452c-8b08-3d90f3e97294" returned: 0 in 0.275s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-e146bfde-3740-452c-8b08-3d90f3e97294" released by "_delete_snapshot" :: held 1.496s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" released by "delete_snapshot" :: held 1.529s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Created reservations ['cb883d0d-43d6-4bec-81fb-5dd9bfdfd42e', 'b450b3c2-31c0-4174-b08f-ca531e87e95d', '153412bd-683b-4714-8f24-bea397a8396b', '5c3c9f7f-81af-477c-ac1e-b42794c1581d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Delete snapshot completed successfully. Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8f72ff9c-e56b-4611-a031-9b4fac69bc00 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-e146bfde-3740-452c-8b08-3d90f3e97294-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:02 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:02 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59 Nov 02 09:53:02 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:02 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.791f484c-c005-40b0-bfd4-972bb60a7b59" returned: 0 in 0.258s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-791f484c-c005-40b0-bfd4-972bb60a7b59" released by "_delete_snapshot" :: held 1.566s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" released by "delete_snapshot" :: held 1.590s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-270cdc5f-461e-4529-a9e6-7ee3d88752a3-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-270cdc5f-461e-4529-a9e6-7ee3d88752a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:02 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Created reservations ['c1113de0-2861-4f95-9ed8-804abb72358a', 'f8df8528-8bc5-480c-9962-63044f378138', '1680b3aa-3cf8-4527-a150-ba102c5dddf4', 'f53f9968-1de3-4d56-9a7f-0109145e9260'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88415a4-0b7c-4dcd-8dc6-9aacc682c323]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Delete snapshot completed successfully. Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bf6c8a5b-3412-452c-a984-dab68267083b tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-791f484c-c005-40b0-bfd4-972bb60a7b59-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:03 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 Nov 02 09:53:03 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-53fcb438-50e9-4c5a-9004-6340c51cd2cc-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-53fcb438-50e9-4c5a-9004-6340c51cd2cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-53fcb438-50e9-4c5a-9004-6340c51cd2cc" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-53fcb438-50e9-4c5a-9004-6340c51cd2cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Deleting offline snapshot 53fcb438-50e9-4c5a-9004-6340c51cd2cc of volume fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] snapshot_file for this snap is: volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda2ebe-0b8b-4359-971d-4f8b662c123b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:03 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3" returned: 0 in 0.474s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:03 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3 Nov 02 09:53:03 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:03 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:53:03 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:03 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-270cdc5f-461e-4529-a9e6-7ee3d88752a3" returned: 0 in 0.297s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-270cdc5f-461e-4529-a9e6-7ee3d88752a3" released by "delete_volume" :: held 0.856s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:03 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Created reservations ['9661fb75-c393-4fd4-af8e-abd8fe996499', 'c1b35c5e-f764-4449-b116-b576a1f320a7', '2227e1a2-75ee-45ee-b40f-af0384c52de8', '8037d3a2-1ad6-4559-a9b8-1d4e88ff0601'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:04 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.463s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c6f03-4dcc-4a4d-83dd-32e18429369b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:53:04 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 Nov 02 09:53:04 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-6eccfe92-cfb6-4a68-9bbe-f75f78467283-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-6eccfe92-cfb6-4a68-9bbe-f75f78467283-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "cinder-quobyte-6eccfe92-cfb6-4a68-9bbe-f75f78467283" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-6eccfe92-cfb6-4a68-9bbe-f75f78467283" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d457c8e-86c5-40d4-8967-b684737a0922]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 Nov 02 09:53:04 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.294s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:53:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Deleted volume successfully. Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-6f109381-e189-42a3-9183-3efa69480e09 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-270cdc5f-461e-4529-a9e6-7ee3d88752a3-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:04 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:53:04 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283" returned: 0 in 0.397s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283 Nov 02 09:53:04 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.373s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:04 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc Nov 02 09:53:04 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:04 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-6eccfe92-cfb6-4a68-9bbe-f75f78467283" returned: 0 in 0.259s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-quobyte-6eccfe92-cfb6-4a68-9bbe-f75f78467283" released by "delete_volume" :: held 0.702s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Created reservations ['43292c87-6a70-4ca3-92a6-0dcae5ad48bc', '0b5a87d5-5184-43f9-a85d-45ea370a262b', 'c36f5528-2b22-424f-a67e-ce5b36deaa11', '3fc43b3a-16ec-4356-abc1-5fde4852b75e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:05 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:53:05 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:05 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1.53fcb438-50e9-4c5a-9004-6340c51cd2cc" returned: 0 in 0.316s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-53fcb438-50e9-4c5a-9004-6340c51cd2cc" released by "_delete_snapshot" :: held 1.733s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" released by "delete_snapshot" :: held 1.761s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Created reservations ['157282ce-2f02-4b02-a177-c8ce90457cef', '3c4a588e-de0e-410d-b92b-5c2e3d7eecaa', '6f4bb89b-6b0c-44e7-a7d9-b57b41978068', '686ccc7e-ce7d-4c36-b58b-e6eae1031613'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Delete snapshot completed successfully. Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-402dc84b-cbf8-4b47-a3df-529b5e3b41df tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-53fcb438-50e9-4c5a-9004-6340c51cd2cc-delete_snapshot" released by "delete_snapshot" :: held 1.939s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:05 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.333s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:53:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Deleted volume successfully. Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2baffc70-948c-4231-a7c0-f81c0834eff2 tempest-CinderUnicodeTest-927740810 None] Lock "cinder-6eccfe92-cfb6-4a68-9bbe-f75f78467283-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-fa40a4d7-a30c-47c7-8cc9-342a52a836a1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-fa40a4d7-a30c-47c7-8cc9-342a52a836a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab17be9c-c98f-47e5-aa5a-ca06cac48b3d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:53:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:05 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 Nov 02 09:53:05 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:06 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" returned: 0 in 0.432s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:06 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1 Nov 02 09:53:06 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:06 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" returned: 0 in 0.336s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-quobyte-fa40a4d7-a30c-47c7-8cc9-342a52a836a1" released by "delete_volume" :: held 0.849s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Created reservations ['aa39c982-154f-4220-a18d-48ba24848067', 'dd8f5e77-0b2f-4af5-8613-b5639f66465e', 'fb9d3059-17e5-47ca-a387-99a14c5a0604', '66797d8c-2df6-40c2-8b94-81a036955d10'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:53:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:06 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:53:06 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:07 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:07 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:53:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Deleted volume successfully. Nov 02 09:53:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dd9c63f6-45cd-404b-a314-7e1371dd2002 tempest-VolumesSnapshotListTestJSON-586458197 None] Lock "cinder-fa40a4d7-a30c-47c7-8cc9-342a52a836a1-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:53:16 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=103,cinder:SELECT=79,cinder:INSERT=33,cinder:DELETE=8 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:53:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=81,cinder:INSERT=26,cinder:UPDATE=91,cinder:DELETE=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:53:58 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:53:58 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:53:58 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.263s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:53:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Flow 'volume_create_manager' (d50d1762-1c08-41e5-870a-bf4649c44d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9d9f3a-dd14-49b6-b0c2-79228875b2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9d9f3a-dd14-49b6-b0c2-79228875b2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-509749710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1e756-faf4-459b-bcc0-a3457911e56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b328793bdcfd4d3d8f18cb0ef500e3aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:02Z,use_quota=True,user_id='4de1d4772a63428e8d4db8804c455640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec9f24-72c3-42a1-b614-5aa9ff40a906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec9f24-72c3-42a1-b614-5aa9ff40a906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41360dd7-9941-4923-97db-0b9fc91d33d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41360dd7-9941-4923-97db-0b9fc91d33d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e1e756-faf4-459b-bcc0-a3457911e56b', 'volume_name': 'volume-a4e1e756-faf4-459b-bcc0-a3457911e56b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1684bc2-b69d-45c2-a228-643723b78546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1684bc2-b69d-45c2-a228-643723b78546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43e6052-3811-4159-9df0-6ab6ce3882d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Volume a4e1e756-faf4-459b-bcc0-a3457911e56b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e1e756-faf4-459b-bcc0-a3457911e56b', 'volume_size': 1} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-509749710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e1e756-faf4-459b-bcc0-a3457911e56b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b328793bdcfd4d3d8f18cb0ef500e3aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:02Z,use_quota=True,user_id='4de1d4772a63428e8d4db8804c455640',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Creating volume a4e1e756-faf4-459b-bcc0-a3457911e56b {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:54:02 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:02 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b 1073741824 Nov 02 09:54:02 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:02 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b 1073741824" returned: 0 in 0.510s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:02 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b Nov 02 09:54:02 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:03 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b" returned: 0 in 0.309s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43e6052-3811-4159-9df0-6ab6ce3882d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e1e756-faf4-459b-bcc0-a3457911e56b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b75dda0-9296-4b75-9252-bd0f81ac2b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:03 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Volume volume-a4e1e756-faf4-459b-bcc0-a3457911e56b (a4e1e756-faf4-459b-bcc0-a3457911e56b): created successfully Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b75dda0-9296-4b75-9252-bd0f81ac2b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Flow 'volume_create_manager' (d50d1762-1c08-41e5-870a-bf4649c44d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5be341df-a55a-4770-b0e0-358bff4ab065 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Created volume successfully. Nov 02 09:54:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-8e376241-b75c-417a-85ca-5b01d6305012 req-4a3a7b19-0852-4248-98ea-af18f7be9adf tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-8e376241-b75c-417a-85ca-5b01d6305012 req-4a3a7b19-0852-4248-98ea-af18f7be9adf tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-8e376241-b75c-417a-85ca-5b01d6305012 req-4a3a7b19-0852-4248-98ea-af18f7be9adf tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-8e376241-b75c-417a-85ca-5b01d6305012 req-4a3a7b19-0852-4248-98ea-af18f7be9adf tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-a4e1e756-faf4-459b-bcc0-a3457911e56b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1894ebcf-2fb7-4de9-a565-f99a1f458476', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:54:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-8e376241-b75c-417a-85ca-5b01d6305012 req-4a3a7b19-0852-4248-98ea-af18f7be9adf tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] attachment_update completed successfully. Nov 02 09:54:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-bcd25b72-fd2b-46d6-bc5c-6a46c4f6b05a req-c84a037a-cc62-4fad-a368-e06ab4484fe0 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Terminate volume connection completed successfully. Nov 02 09:54:08 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-bcd25b72-fd2b-46d6-bc5c-6a46c4f6b05a req-c84a037a-cc62-4fad-a368-e06ab4484fe0 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Deleting attachment 1894ebcf-2fb7-4de9-a565-f99a1f458476. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "cinder-a4e1e756-faf4-459b-bcc0-a3457911e56b-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "cinder-a4e1e756-faf4-459b-bcc0-a3457911e56b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "cinder-quobyte-a4e1e756-faf4-459b-bcc0-a3457911e56b" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "cinder-quobyte-a4e1e756-faf4-459b-bcc0-a3457911e56b" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa150ef-fc09-499a-8671-ff9cdc6e55d2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:09 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b Nov 02 09:54:09 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:09 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:09 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b Nov 02 09:54:09 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:09 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a4e1e756-faf4-459b-bcc0-a3457911e56b" returned: 0 in 0.245s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "cinder-quobyte-a4e1e756-faf4-459b-bcc0-a3457911e56b" released by "delete_volume" :: held 0.668s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:54:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Created reservations ['756b986a-fa55-4b94-882d-0f6d8c6b704d', '25f7a9de-73a9-4478-b2a0-f6534456ad29', '3a511b9e-1f1d-42f4-b539-0f1f329d2acd', '9dd2cf72-a4de-45a4-85ba-18722f1615a9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:10 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:54:10 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:10 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.259s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:54:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Deleted volume successfully. Nov 02 09:54:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-592415d3-a5b5-4ccd-a53f-4db6963cabd7 tempest-TestServerVolumeAttachScenarioOldVersion-1366470270 None] Lock "cinder-a4e1e756-faf4-459b-bcc0-a3457911e56b-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:54:20 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=18,cinder:SELECT=10,cinder:INSERT=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:54:20 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Flow 'volume_create_manager' (5ceff7af-24c4-40b3-8441-9de89b0a8c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d812bd30-3ea9-448f-9367-431201a512b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d812bd30-3ea9-448f-9367-431201a512b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986726435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609971d8-f77b-41d3-a191-7f45b1c2891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8935ed8ac304ee2b912181ae98059f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:47Z,use_quota=True,user_id='cf29cddcb9be4b61a78507da018fa782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b45ea46-2654-4895-9080-ca66f9918e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b45ea46-2654-4895-9080-ca66f9918e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42e1a4a-00f6-4301-8e1a-781a6d0ea1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42e1a4a-00f6-4301-8e1a-781a6d0ea1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '609971d8-f77b-41d3-a191-7f45b1c2891f', 'volume_name': 'volume-609971d8-f77b-41d3-a191-7f45b1c2891f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c54f0e-2cba-45c2-81ed-49da33bdf2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c54f0e-2cba-45c2-81ed-49da33bdf2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afc065d-29e9-4185-b5c1-432023c5f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume 609971d8-f77b-41d3-a191-7f45b1c2891f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-609971d8-f77b-41d3-a191-7f45b1c2891f', 'volume_size': 1} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-986726435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609971d8-f77b-41d3-a191-7f45b1c2891f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8935ed8ac304ee2b912181ae98059f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:47Z,use_quota=True,user_id='cf29cddcb9be4b61a78507da018fa782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Creating volume 609971d8-f77b-41d3-a191-7f45b1c2891f {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:54:46 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:54:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:46 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f 1073741824 Nov 02 09:54:46 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Flow 'volume_create_manager' (3f75e366-71a4-46c7-8fc4-fb91dca08f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ecc536-834d-4180-a6d5-21e9449efd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ecc536-834d-4180-a6d5-21e9449efd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1023513845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514dbf5e-cc09-4511-94cc-356ad8664bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8935ed8ac304ee2b912181ae98059f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:47Z,use_quota=True,user_id='cf29cddcb9be4b61a78507da018fa782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefe8f59-0876-4846-beef-a5ab7feaa2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefe8f59-0876-4846-beef-a5ab7feaa2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3507c3ee-7b46-48d7-98d3-a7e4da01a35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3507c3ee-7b46-48d7-98d3-a7e4da01a35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514dbf5e-cc09-4511-94cc-356ad8664bd6', 'volume_name': 'volume-514dbf5e-cc09-4511-94cc-356ad8664bd6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204ec2cf-7c6e-4ce5-b7fd-b0ca1ed76967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204ec2cf-7c6e-4ce5-b7fd-b0ca1ed76967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af8371-7164-4ec9-b9ae-2d86a212a455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume 514dbf5e-cc09-4511-94cc-356ad8664bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514dbf5e-cc09-4511-94cc-356ad8664bd6', 'volume_size': 1} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:47 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f 1073741824" returned: 0 in 0.626s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:47 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f Nov 02 09:54:47 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:47 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1023513845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514dbf5e-cc09-4511-94cc-356ad8664bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8935ed8ac304ee2b912181ae98059f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:54:47Z,use_quota=True,user_id='cf29cddcb9be4b61a78507da018fa782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Creating volume 514dbf5e-cc09-4511-94cc-356ad8664bd6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:54:47 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afc065d-29e9-4185-b5c1-432023c5f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609971d8-f77b-41d3-a191-7f45b1c2891f', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 1073741824 Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4823146-8f92-4329-a7de-5c5462b41f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:47 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume volume-609971d8-f77b-41d3-a191-7f45b1c2891f (609971d8-f77b-41d3-a191-7f45b1c2891f): created successfully Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4823146-8f92-4329-a7de-5c5462b41f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Flow 'volume_create_manager' (5ceff7af-24c4-40b3-8441-9de89b0a8c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f3d931b3-1b6d-491d-b105-effff866b0b7 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Created volume successfully. Nov 02 09:54:48 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 1073741824" returned: 0 in 0.596s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:48 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 Nov 02 09:54:48 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:48 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af8371-7164-4ec9-b9ae-2d86a212a455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514dbf5e-cc09-4511-94cc-356ad8664bd6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d706ae3d-e695-4ea1-b79c-1b59440a9bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:54:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Volume volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 (514dbf5e-cc09-4511-94cc-356ad8664bd6): created successfully Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d706ae3d-e695-4ea1-b79c-1b59440a9bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:54:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Flow 'volume_create_manager' (3f75e366-71a4-46c7-8fc4-fb91dca08f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:54:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d95f06c0-33b1-4aa0-b1b1-59c800961ac3 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Created volume successfully. Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:54:58 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:54:58 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:54:58 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:54:58 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-4666ca50-5b25-477f-a518-b4d54aab078b req-90cdcebd-6ded-46dc-b263-15f33877103a tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-4666ca50-5b25-477f-a518-b4d54aab078b req-90cdcebd-6ded-46dc-b263-15f33877103a tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-4666ca50-5b25-477f-a518-b4d54aab078b req-90cdcebd-6ded-46dc-b263-15f33877103a tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-4666ca50-5b25-477f-a518-b4d54aab078b req-90cdcebd-6ded-46dc-b263-15f33877103a tempest-TestServerVolumeAttachmentScenario-1910740565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-609971d8-f77b-41d3-a191-7f45b1c2891f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27f1da94-9a26-4212-bf96-688c0f56657f', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:55:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-4666ca50-5b25-477f-a518-b4d54aab078b req-90cdcebd-6ded-46dc-b263-15f33877103a tempest-TestServerVolumeAttachmentScenario-1910740565 None] attachment_update completed successfully. Nov 02 09:55:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a7669d98-c35d-4e40-9ef8-268af82e0f74 req-8d00ea7b-03b4-4384-8961-6011220c24c4 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a7669d98-c35d-4e40-9ef8-268af82e0f74 req-8d00ea7b-03b4-4384-8961-6011220c24c4 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [req-a7669d98-c35d-4e40-9ef8-268af82e0f74 req-8d00ea7b-03b4-4384-8961-6011220c24c4 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-a7669d98-c35d-4e40-9ef8-268af82e0f74 req-8d00ea7b-03b4-4384-8961-6011220c24c4 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5', 'name': 'volume-514dbf5e-cc09-4511-94cc-356ad8664bd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddea8f1b-7e17-4397-8876-495558605572', 'enforce_multipath': True} {{(pid=86887) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 09:55:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-a7669d98-c35d-4e40-9ef8-268af82e0f74 req-8d00ea7b-03b4-4384-8961-6011220c24c4 tempest-TestServerVolumeAttachmentScenario-1910740565 None] attachment_update completed successfully. Nov 02 09:55:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-f3e4b918-ae36-4d25-89ad-1b30d2221458 req-72de734b-e848-44fc-a2e4-f781da18289b tempest-TestServerVolumeAttachmentScenario-1910740565 None] Terminate volume connection completed successfully. Nov 02 09:55:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-f3e4b918-ae36-4d25-89ad-1b30d2221458 req-72de734b-e848-44fc-a2e4-f781da18289b tempest-TestServerVolumeAttachmentScenario-1910740565 None] Deleting attachment ddea8f1b-7e17-4397-8876-495558605572. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:55:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [req-bade4209-5a03-4728-9a4b-e84f1ab1eb54 req-00c272af-4e09-4079-99bb-05089ae93547 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Terminate volume connection completed successfully. Nov 02 09:55:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [req-bade4209-5a03-4728-9a4b-e84f1ab1eb54 req-00c272af-4e09-4079-99bb-05089ae93547 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Deleting attachment 27f1da94-9a26-4212-bf96-688c0f56657f. {{(pid=86887) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "cinder-514dbf5e-cc09-4511-94cc-356ad8664bd6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-514dbf5e-cc09-4511-94cc-356ad8664bd6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "cinder-quobyte-514dbf5e-cc09-4511-94cc-356ad8664bd6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-quobyte-514dbf5e-cc09-4511-94cc-356ad8664bd6" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d63686-a283-4166-b047-3fec18aea5b4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:55:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:32 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 Nov 02 09:55:32 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:33 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6" returned: 0 in 0.421s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:33 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6 Nov 02 09:55:33 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:33 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-514dbf5e-cc09-4511-94cc-356ad8664bd6" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-quobyte-514dbf5e-cc09-4511-94cc-356ad8664bd6" released by "delete_volume" :: held 0.758s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Created reservations ['11a21ddd-e21a-46bd-bd81-7be7bb9d11b3', '0658ca40-fa09-47ec-910f-e52d36576648', '43989236-adba-4f07-b7fc-82f19d1e237a', '8249b4c4-0467-4cb0-95d3-2b21602451e9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:33 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:55:33 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "cinder-609971d8-f77b-41d3-a191-7f45b1c2891f-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-609971d8-f77b-41d3-a191-7f45b1c2891f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "cinder-quobyte-609971d8-f77b-41d3-a191-7f45b1c2891f" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-quobyte-609971d8-f77b-41d3-a191-7f45b1c2891f" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:34 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02bdcec-9ff7-488e-9c6b-55453725d37f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Deleted volume successfully. Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c971bb09-9b6e-42cb-bf5b-4ec58845cbd2 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-514dbf5e-cc09-4511-94cc-356ad8664bd6-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:34 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f Nov 02 09:55:34 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:34 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f" returned: 0 in 0.431s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:34 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f Nov 02 09:55:34 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:34 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-609971d8-f77b-41d3-a191-7f45b1c2891f" returned: 0 in 0.281s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-quobyte-609971d8-f77b-41d3-a191-7f45b1c2891f" released by "delete_volume" :: held 0.768s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Created reservations ['0fd41749-242d-443f-9438-6a4cd85c7b39', 'bff10104-2dcd-4992-b3ce-06b3125e3abc', '3f274578-39bc-43fc-a1d2-43b891196749', '6abb1dd9-c83e-42d0-985c-d67bc6212b06'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:34 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:55:34 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:35 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.272s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:35 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Deleted volume successfully. Nov 02 09:55:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fb113190-ddf7-4085-b06a-e5e57c6934e8 tempest-TestServerVolumeAttachmentScenario-1910740565 None] Lock "cinder-609971d8-f77b-41d3-a191-7f45b1c2891f-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:44 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:45 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (c2794946-6b3e-41e8-972f-608a545599cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351b8727-51c0-478a-aace-d5a519e82304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351b8727-51c0-478a-aace-d5a519e82304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363501181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5689d87-0dc8-4e6e-bd2d-e8306c786e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:55:54Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ed148-b33f-464b-916e-c122c0781821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (282ed148-b33f-464b-916e-c122c0781821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ce736-cebe-4e08-86f5-4914a645c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5ce736-cebe-4e08-86f5-4914a645c496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5689d87-0dc8-4e6e-bd2d-e8306c786e4c', 'volume_name': 'volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63259f91-634b-4dd0-ab1e-6581eef070e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63259f91-634b-4dd0-ab1e-6581eef070e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d0c3a8-a90d-4818-beb3-777716557e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:53 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Volume e5689d87-0dc8-4e6e-bd2d-e8306c786e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c', 'volume_size': 1} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363501181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5689d87-0dc8-4e6e-bd2d-e8306c786e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:55:54Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Creating volume e5689d87-0dc8-4e6e-bd2d-e8306c786e4c {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:55:53 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:55:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:53 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c 1073741824 Nov 02 09:55:53 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:54 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c 1073741824" returned: 0 in 0.499s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:54 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c Nov 02 09:55:54 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:54 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" returned: 0 in 0.271s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d0c3a8-a90d-4818-beb3-777716557e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9199ba10-4ffa-4360-8698-b3ac8a9cc638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Volume volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c (e5689d87-0dc8-4e6e-bd2d-e8306c786e4c): created successfully Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9199ba10-4ffa-4360-8698-b3ac8a9cc638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (c2794946-6b3e-41e8-972f-608a545599cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:55:54 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-43aafd0e-c0f5-4594-b61f-adc41f56b7b7 tempest-ProjectReaderTests-1173191436 None] Created volume successfully. Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-quobyte-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7eff8f4-2103-4cbf-9f87-d81e9628c21e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:56 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c Nov 02 09:55:56 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:56 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" returned: 0 in 0.400s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:56 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c Nov 02 09:55:56 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:56 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" returned: 0 in 0.276s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c" released by "delete_volume" :: held 0.726s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Created reservations ['5a3da502-2eba-4eca-abc0-721635e6f1e6', 'ef5724fd-27c8-4378-8743-fe34b08c0bb4', '2d17130a-db03-40be-8f00-d151a7e3a039', 'f500e5da-4d4a-4cd5-98df-d97e4d53d9f3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:57 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:55:57 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:57 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.282s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Deleted volume successfully. Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1382fca5-9de0-45e0-8a0c-eeed6c08c819 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-e5689d87-0dc8-4e6e-bd2d-e8306c786e4c-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (e3d9d8ae-dfe2-4303-a8b4-ec3f857d0d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866fe777-af34-42c7-84e6-e566bde4a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866fe777-af34-42c7-84e6-e566bde4a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657188605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5303047-ff12-45bf-8ad9-a7a254770b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:55:58Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d43e0-f360-4d93-8520-f68df3195496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3d43e0-f360-4d93-8520-f68df3195496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384c05d-219b-415a-b104-112d97841d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384c05d-219b-415a-b104-112d97841d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5303047-ff12-45bf-8ad9-a7a254770b13', 'volume_name': 'volume-f5303047-ff12-45bf-8ad9-a7a254770b13', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3622df5-116f-4d88-b789-e11976168ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3622df5-116f-4d88-b789-e11976168ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e37910a-1a2a-48a3-87c0-c16e50fc11f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:57 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Volume f5303047-ff12-45bf-8ad9-a7a254770b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5303047-ff12-45bf-8ad9-a7a254770b13', 'volume_size': 1} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657188605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5303047-ff12-45bf-8ad9-a7a254770b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:55:58Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Creating volume f5303047-ff12-45bf-8ad9-a7a254770b13 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:55:57 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:55:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:58 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 1073741824 Nov 02 09:55:58 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:58 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:55:58 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:58 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:55:58 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 1073741824" returned: 0 in 0.614s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:55:58 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 Nov 02 09:55:58 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:55:58 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13" returned: 0 in 0.255s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e37910a-1a2a-48a3-87c0-c16e50fc11f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5303047-ff12-45bf-8ad9-a7a254770b13', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86093e30-3c89-4f4f-9ce9-2f5249e7e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:55:58 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Volume volume-f5303047-ff12-45bf-8ad9-a7a254770b13 (f5303047-ff12-45bf-8ad9-a7a254770b13): created successfully Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86093e30-3c89-4f4f-9ce9-2f5249e7e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:55:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (e3d9d8ae-dfe2-4303-a8b4-ec3f857d0d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:55:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-51fd09d3-50df-4821-a1d2-768ffd6419b3 tempest-ProjectReaderTests-1173191436 None] Created volume successfully. Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-f5303047-ff12-45bf-8ad9-a7a254770b13-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-f5303047-ff12-45bf-8ad9-a7a254770b13-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-quobyte-f5303047-ff12-45bf-8ad9-a7a254770b13" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-f5303047-ff12-45bf-8ad9-a7a254770b13" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be971ca-0da9-4031-8bce-da43b26bdbb9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:00 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 Nov 02 09:56:00 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:00 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13" returned: 0 in 0.400s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:00 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13 Nov 02 09:56:00 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:00 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-f5303047-ff12-45bf-8ad9-a7a254770b13" returned: 0 in 0.268s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-f5303047-ff12-45bf-8ad9-a7a254770b13" released by "delete_volume" :: held 0.711s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Created reservations ['e6b9493e-0cfe-422d-b5e4-df4ee550c2f8', '5536f0f6-8396-47cc-b417-e61e24a935d4', 'c7318d7e-a7a1-43cf-8a3a-85a124929fcf', '1b453bf6-0534-47d4-80fa-d653a832b56e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:00 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:00 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:01 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Deleted volume successfully. Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8d2e3ff4-5cae-40ae-a236-32ea7d1f8918 tempest-ProjectReaderTests-1173191436 None] Lock "cinder-f5303047-ff12-45bf-8ad9-a7a254770b13-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (34a80150-4782-479c-8632-100a76a30c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d201fa5-28dc-4464-a27b-1eb8a14c04a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d201fa5-28dc-4464-a27b-1eb8a14c04a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964741199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66594896-dad8-4da4-83cc-e37bfdfe4de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:02Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2196803-a9f7-4d2f-bf9c-c83406fb6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2196803-a9f7-4d2f-bf9c-c83406fb6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2101f448-c833-43dd-8b5b-c66b841e6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2101f448-c833-43dd-8b5b-c66b841e6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66594896-dad8-4da4-83cc-e37bfdfe4de9', 'volume_name': 'volume-66594896-dad8-4da4-83cc-e37bfdfe4de9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc1b88d-b334-4ce9-9485-e56af715e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc1b88d-b334-4ce9-9485-e56af715e13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52ac33d-c45f-4ac8-8db4-317f118bdc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Volume 66594896-dad8-4da4-83cc-e37bfdfe4de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66594896-dad8-4da4-83cc-e37bfdfe4de9', 'volume_size': 1} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1964741199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66594896-dad8-4da4-83cc-e37bfdfe4de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:02Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Creating volume 66594896-dad8-4da4-83cc-e37bfdfe4de9 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:56:01 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:56:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:01 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 1073741824 Nov 02 09:56:01 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:02 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 1073741824" returned: 0 in 0.533s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:02 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 Nov 02 09:56:02 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:02 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52ac33d-c45f-4ac8-8db4-317f118bdc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66594896-dad8-4da4-83cc-e37bfdfe4de9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c67d2-a4d9-4617-aa9f-82024bf136aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Volume volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 (66594896-dad8-4da4-83cc-e37bfdfe4de9): created successfully Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a7c67d2-a4d9-4617-aa9f-82024bf136aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (34a80150-4782-479c-8632-100a76a30c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c42d718e-a473-41c1-9921-896bfb4c4490 tempest-ProjectReaderTests-1173191436 None] Created volume successfully. Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-66594896-dad8-4da4-83cc-e37bfdfe4de9-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "cinder-66594896-dad8-4da4-83cc-e37bfdfe4de9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-quobyte-66594896-dad8-4da4-83cc-e37bfdfe4de9" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-66594896-dad8-4da4-83cc-e37bfdfe4de9" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6961752-d999-43b5-9246-201ca4c15715]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:04 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 Nov 02 09:56:04 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:04 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9" returned: 0 in 0.376s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:04 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9 Nov 02 09:56:04 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:04 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-66594896-dad8-4da4-83cc-e37bfdfe4de9" returned: 0 in 0.270s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-66594896-dad8-4da4-83cc-e37bfdfe4de9" released by "delete_volume" :: held 0.694s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Created reservations ['6431857f-b72b-4a17-979f-a065672180c2', '09c43199-d218-4e5d-8fc3-55fa06e17147', '5c7bf30d-02d4-461c-9596-92631f296bec', '3af2954d-6a26-430c-904d-c95eb9c70819'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:04 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:04 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:05 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.269s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Deleted volume successfully. Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-91de0211-6d7b-447e-9470-186c4a4a418b tempest-ProjectReaderTests-1173191436 None] Lock "cinder-66594896-dad8-4da4-83cc-e37bfdfe4de9-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (6283b341-8a4d-47c6-b071-4c5c6e3782f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dd8c76-99e5-4648-8eae-480669396a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25dd8c76-99e5-4648-8eae-480669396a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516406376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe80c09-d00f-4557-b076-5306d89c124a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:05Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab45a09-f9a5-43c4-b068-d4ea2ee03eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab45a09-f9a5-43c4-b068-d4ea2ee03eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231328b7-b9bd-4ec6-8411-8e0433d30be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231328b7-b9bd-4ec6-8411-8e0433d30be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe80c09-d00f-4557-b076-5306d89c124a', 'volume_name': 'volume-0fe80c09-d00f-4557-b076-5306d89c124a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b39eaa6-c0b6-44e9-8751-e4c9ff6fe329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b39eaa6-c0b6-44e9-8751-e4c9ff6fe329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94279ad9-210a-482e-8485-eb710373178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Volume 0fe80c09-d00f-4557-b076-5306d89c124a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe80c09-d00f-4557-b076-5306d89c124a', 'volume_size': 1} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1516406376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe80c09-d00f-4557-b076-5306d89c124a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9d226c6d6a4acab9c1b5f458c79bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:05Z,use_quota=True,user_id='cdfec2acd4b4488989598d2a423d365d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Creating volume 0fe80c09-d00f-4557-b076-5306d89c124a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:56:05 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:56:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:05 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a 1073741824 Nov 02 09:56:05 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:06 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a 1073741824" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:06 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a Nov 02 09:56:06 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:06 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a" returned: 0 in 0.259s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94279ad9-210a-482e-8485-eb710373178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe80c09-d00f-4557-b076-5306d89c124a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f7faf0-2ddf-4828-8c93-1891a5c8d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:06 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Volume volume-0fe80c09-d00f-4557-b076-5306d89c124a (0fe80c09-d00f-4557-b076-5306d89c124a): created successfully Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f7faf0-2ddf-4828-8c93-1891a5c8d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Flow 'volume_create_manager' (6283b341-8a4d-47c6-b071-4c5c6e3782f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ea3e50fe-78b1-4239-860c-7f0471e10c3e tempest-ProjectReaderTests-1173191436 None] Created volume successfully. Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-0fe80c09-d00f-4557-b076-5306d89c124a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "cinder-0fe80c09-d00f-4557-b076-5306d89c124a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Acquiring lock "cinder-quobyte-0fe80c09-d00f-4557-b076-5306d89c124a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-0fe80c09-d00f-4557-b076-5306d89c124a" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed7010-c267-4ec9-b21a-5bf3b06d4679]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:06 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a Nov 02 09:56:06 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:07 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:07 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a Nov 02 09:56:07 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:07 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0fe80c09-d00f-4557-b076-5306d89c124a" returned: 0 in 0.256s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "cinder-quobyte-0fe80c09-d00f-4557-b076-5306d89c124a" released by "delete_volume" :: held 0.688s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Created reservations ['23462990-5ef8-4395-8991-3af1a568bcb2', 'd145cf25-c2ff-4161-8dba-381f50bc0dab', '3652d97d-83bd-4f5f-b603-e53112337e04', '1cc8d746-eb81-4c8e-80ea-8c9bc1ef211c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:07 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:07 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:07 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.256s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Deleted volume successfully. Nov 02 09:56:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-44ca4f05-ba12-4970-be42-e0d8bd9be57d tempest-ProjectReaderTests-1173191436 None] Lock "cinder-0fe80c09-d00f-4557-b076-5306d89c124a-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=27,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:17 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=50,cinder:SELECT=29,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Flow 'volume_create_manager' (d85776cc-b217-469e-b54b-e922d581e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e950b5-7b63-4730-a394-c89d85c08d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e950b5-7b63-4730-a394-c89d85c08d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-149494129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0493be-f87c-4e09-b91a-256cdaf8b011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c73d8649d4439781bbea9d48ffb000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:34Z,use_quota=True,user_id='b270b463e714442487c9567aab7887e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3c18f4-0fb7-4b3a-a9a3-3776b966aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3c18f4-0fb7-4b3a-a9a3-3776b966aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d4b993-6500-42ab-8f94-9677598737d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d4b993-6500-42ab-8f94-9677598737d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0493be-f87c-4e09-b91a-256cdaf8b011', 'volume_name': 'volume-9d0493be-f87c-4e09-b91a-256cdaf8b011', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ea842-c9c7-4f80-b526-4eeddf7aaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4ea842-c9c7-4f80-b526-4eeddf7aaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9232d7a-207a-49ab-a5cc-1080b04b39da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:33 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Volume 9d0493be-f87c-4e09-b91a-256cdaf8b011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0493be-f87c-4e09-b91a-256cdaf8b011', 'volume_size': 1} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-149494129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0493be-f87c-4e09-b91a-256cdaf8b011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c73d8649d4439781bbea9d48ffb000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:34Z,use_quota=True,user_id='b270b463e714442487c9567aab7887e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Creating volume 9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:56:33 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:56:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:33 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 1073741824 Nov 02 09:56:33 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:34 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 1073741824" returned: 0 in 0.433s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:34 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:34 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:34 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.261s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9232d7a-207a-49ab-a5cc-1080b04b39da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0493be-f87c-4e09-b91a-256cdaf8b011', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6803b544-01b2-44e7-9a0d-c0e15275590e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:34 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Volume volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 (9d0493be-f87c-4e09-b91a-256cdaf8b011): created successfully Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6803b544-01b2-44e7-9a0d-c0e15275590e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Flow 'volume_create_manager' (d85776cc-b217-469e-b54b-e922d581e00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4624a6e2-49f9-4659-96b0-370cb000376b tempest-SnapshotDependencyTests-2051747527 None] Created volume successfully. Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Creating offline snapshot 77bb209e-8382-47f1-a6f4-cc2d65a3e4fc of volume 9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[34414439-1c88-457e-ab75-de3f7173c3dc]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:35 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:35 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:35 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.362s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:35 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc 1G Nov 02 09:56:35 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:35 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc 1G" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:35 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:35 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:36 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.309s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:36 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc is being set with open permissions: ugo+rw Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:36 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:36 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:36 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.264s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:36 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info Nov 02 09:56:36 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:36 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info" returned: 0 in 0.250s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:36 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info is being set with open permissions: ugo+rw Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:36 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info Nov 02 09:56:36 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:36 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.info" returned: 0 in 0.248s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:36 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-99d60ac2-8765-4acd-96b3-bcd4c0dd2d98 tempest-SnapshotDependencyTests-2051747527 None] Create snapshot completed successfully Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Flow 'volume_create_manager' (38bea1a1-0e4b-48e0-9138-3508fabf467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f981efa3-428b-49c5-8f6f-90085ffb6488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f981efa3-428b-49c5-8f6f-90085ffb6488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3a80cc-b475-43b9-ab85-bea45535fb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27c73d8649d4439781bbea9d48ffb000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77bb209e-8382-47f1-a6f4-cc2d65a3e4fc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:56:38Z,use_quota=True,user_id='b270b463e714442487c9567aab7887e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddae337a-dd86-4ee9-8a31-d84b5571aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddae337a-dd86-4ee9-8a31-d84b5571aab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8921ef-43d5-411c-a240-07ef813373f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8921ef-43d5-411c-a240-07ef813373f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4c3a80cc-b475-43b9-ab85-bea45535fb49', 'volume_name': 'volume-4c3a80cc-b475-43b9-ab85-bea45535fb49', 'volume_size': 1, 'snapshot_id': '77bb209e-8382-47f1-a6f4-cc2d65a3e4fc'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4edc272-fcbf-4863-a2e4-c26f79accae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4edc272-fcbf-4863-a2e4-c26f79accae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d37336-176a-41a6-a1c5-724522da4eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Volume 4c3a80cc-b475-43b9-ab85-bea45535fb49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4c3a80cc-b475-43b9-ab85-bea45535fb49', 'volume_size': 1, 'snapshot_id': '77bb209e-8382-47f1-a6f4-cc2d65a3e4fc'} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-4c3a80cc-b475-43b9-ab85-bea45535fb49" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-4c3a80cc-b475-43b9-ab85-bea45535fb49" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Creating volume 4c3a80cc-b475-43b9-ab85-bea45535fb49 from snapshot 77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] snapshot: 77bb209e-8382-47f1-a6f4-cc2d65a3e4fc, volume: 4c3a80cc-b475-43b9-ab85-bea45535fb49, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43e385b-034b-4e77-9b49-a7ad9bcacad7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:38 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:38 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:38 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0493be-f87c-4e09-b91a-256cdaf8b011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[75036819-61e2-4acc-8633-b638bb9087cc]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:38 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:38 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:38 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.383s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:56:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:38 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 Nov 02 09:56:38 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:44 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49" returned: 0 in 5.722s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:56:44 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Converted 1024.00 MB image at 178.93 MB/s Nov 02 09:56:44 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 is being set with open permissions: ugo+rw Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:44 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 Nov 02 09:56:44 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:44 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49" returned: 0 in 0.227s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" released by "_copy_volume_from_snapshot" :: held 6.770s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-4c3a80cc-b475-43b9-ab85-bea45535fb49" released by "_create_volume_from_snapshot" :: held 6.828s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.844s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d37336-176a-41a6-a1c5-724522da4eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3a80cc-b475-43b9-ab85-bea45535fb49', 'volume_size': 1, 'snapshot_id': '77bb209e-8382-47f1-a6f4-cc2d65a3e4fc'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864200eb-af6a-4feb-b068-e00ed783ed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:56:44 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Volume volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 (4c3a80cc-b475-43b9-ab85-bea45535fb49): created successfully Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864200eb-af6a-4feb-b068-e00ed783ed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:56:44 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Flow 'volume_create_manager' (38bea1a1-0e4b-48e0-9138-3508fabf467e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:56:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-29e34de6-92f8-40d3-9268-7b1f7458b2ad tempest-SnapshotDependencyTests-2051747527 None] Created volume successfully. Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Deleting offline snapshot 77bb209e-8382-47f1-a6f4-cc2d65a3e4fc of volume 9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] snapshot_file for this snap is: volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9494feb3-6627-4953-a167-224ba94351c1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:45 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:45 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:45 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.357s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0493be-f87c-4e09-b91a-256cdaf8b011(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd993283-e388-414f-a22e-44057daa5246]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:45 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:45 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:46 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.513s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:46 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:46 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:46 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.343s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:46 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc Nov 02 09:56:46 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:46 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011.77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" returned: 0 in 0.243s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc" released by "_delete_snapshot" :: held 1.563s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" released by "delete_snapshot" :: held 1.584s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:46 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Created reservations ['50ccf4c0-7e73-4515-8d0e-533bb74da19a', '2b48da59-3d42-471c-8c43-4a5702079b09', 'a641d681-6812-4f36-9709-1fd30cb1b1d2', 'f1b46412-97f4-44ef-b818-8aa49d224daa'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Delete snapshot completed successfully. Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5a6a2c18-9029-436f-b439-359eea666fb1 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-77bb209e-8382-47f1-a6f4-cc2d65a3e4fc-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-9d0493be-f87c-4e09-b91a-256cdaf8b011-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-9d0493be-f87c-4e09-b91a-256cdaf8b011-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfe359-fa9d-4eba-90df-b6e5327ac837]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:47 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:47 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:47 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:47 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011 Nov 02 09:56:47 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:48 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9d0493be-f87c-4e09-b91a-256cdaf8b011" returned: 0 in 0.247s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-9d0493be-f87c-4e09-b91a-256cdaf8b011" released by "delete_volume" :: held 0.670s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Created reservations ['6309acf8-003c-4fcc-ad75-f3bcc2c43844', '4652ab41-da0c-4b60-83fa-8b9c0839e718', '6d3a2388-c00e-4fe1-909c-0b5b548282f7', 'b378f0c3-7d1a-4e66-99d2-f096b6bf9af3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:48 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:48 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:48 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Deleted volume successfully. Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-45a6a7b9-f884-4836-829c-744439395497 tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-9d0493be-f87c-4e09-b91a-256cdaf8b011-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-4c3a80cc-b475-43b9-ab85-bea45535fb49-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-4c3a80cc-b475-43b9-ab85-bea45535fb49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" acquired by "delete_volume" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[db838729-d874-4d26-bc3e-cc0fa7a26aa7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:56:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:48 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 Nov 02 09:56:48 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:49 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49" returned: 0 in 0.362s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:49 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49 Nov 02 09:56:49 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:49 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4c3a80cc-b475-43b9-ab85-bea45535fb49" returned: 0 in 0.236s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-quobyte-4c3a80cc-b475-43b9-ab85-bea45535fb49" released by "delete_volume" :: held 0.638s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Created reservations ['aad78a94-c13e-4f75-a291-d3da6c176d37', '4fc2a338-bdef-440e-8010-d73ef28a4de7', '177167c4-54c3-4d6f-828e-7ad54466b4bf', 'b6fb61bd-ca3a-4a1e-91e7-8575935a402d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:49 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:49 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:49 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.251s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Deleted volume successfully. Nov 02 09:56:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-12619a23-b5b3-4164-804c-c6aa73b88d7d tempest-SnapshotDependencyTests-2051747527 None] Lock "cinder-4c3a80cc-b475-43b9-ab85-bea45535fb49-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:56:58 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:56:58 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:56:58 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:56:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:56:59 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:56:59 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=24,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Flow 'volume_create_manager' (6811c8c0-c360-48f2-95e5-8c483f33bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dac1e74-6bfa-46c4-bf57-6f9685622564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dac1e74-6bfa-46c4-bf57-6f9685622564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-331820989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e103595-7516-4622-8de1-fe4c7ca2a28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895b215011ac47c7892eaba949e19fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:11Z,use_quota=True,user_id='b45ceacc7cdf4ebd9a9de2df9835f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26685e7-61e9-4f77-aa29-9fa3e80b63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26685e7-61e9-4f77-aa29-9fa3e80b63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d027dbb1-13b3-4728-9842-1d9f29b3b925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d027dbb1-13b3-4728-9842-1d9f29b3b925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e103595-7516-4622-8de1-fe4c7ca2a28b', 'volume_name': 'volume-7e103595-7516-4622-8de1-fe4c7ca2a28b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b518903-33e6-4e7f-b0c2-95d4f8e23353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b518903-33e6-4e7f-b0c2-95d4f8e23353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de07ed08-80bc-44d4-8917-283d8f13c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Volume 7e103595-7516-4622-8de1-fe4c7ca2a28b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e103595-7516-4622-8de1-fe4c7ca2a28b', 'volume_size': 1} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-331820989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e103595-7516-4622-8de1-fe4c7ca2a28b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895b215011ac47c7892eaba949e19fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:11Z,use_quota=True,user_id='b45ceacc7cdf4ebd9a9de2df9835f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Creating volume 7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:11 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:11 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b 1073741824 Nov 02 09:57:11 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (ab7fc6d5-2983-459e-af52-e65142096205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15abdb60-922e-4dac-80d7-06b2e3f183fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15abdb60-922e-4dac-80d7-06b2e3f183fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149117743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1136c8f3-0b19-4569-ad61-049c31c01f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1136c8f3-0b19-4569-ad61-049c31c01f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97e535-887d-4362-8740-ae5a07e66ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc97e535-887d-4362-8740-ae5a07e66ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28', 'volume_name': 'volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b500da28-8519-4058-8037-3146124e7d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b500da28-8519-4058-8037-3146124e7d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64e135f-01aa-4d66-9043-3d151a62abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Volume e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28', 'volume_size': 1} Nov 02 09:57:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (543598ed-d6c3-47f6-86bb-2e21f674064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42423c2f-86c7-4eca-b99b-d47e163c540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42423c2f-86c7-4eca-b99b-d47e163c540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-109504645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3fbf0a-cae9-40a9-ae2e-e4de1183b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3fbf0a-cae9-40a9-ae2e-e4de1183b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c80fff4-101b-4337-9503-9000496f4802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c80fff4-101b-4337-9503-9000496f4802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6', 'volume_name': 'volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d41d295-1a9e-45ae-ab96-225ea5644bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d41d295-1a9e-45ae-ab96-225ea5644bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fbdb42-e788-448b-8332-1cbed5f866f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Volume 90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6', 'volume_size': 1} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b 1073741824" returned: 0 in 0.841s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:12 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:12 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (ba4970ba-2f46-4fcc-b815-f23e79e3321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3000151b-df14-4257-9b14-b017f35da5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3000151b-df14-4257-9b14-b017f35da5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864898089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dff57d-532a-4ae9-a311-8dcef49b10df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724f7fb8-036f-4542-ae2e-eb3ab448d834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724f7fb8-036f-4542-ae2e-eb3ab448d834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fd1f9c-8c17-4245-a090-54d55843d3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fd1f9c-8c17-4245-a090-54d55843d3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dff57d-532a-4ae9-a311-8dcef49b10df', 'volume_name': 'volume-b0dff57d-532a-4ae9-a311-8dcef49b10df', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e58d47-d493-4001-86bd-46302cb4e16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e58d47-d493-4001-86bd-46302cb4e16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8da8b7-0ff8-4adf-a794-07f5b71ccdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume b0dff57d-532a-4ae9-a311-8dcef49b10df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dff57d-532a-4ae9-a311-8dcef49b10df', 'volume_size': 1} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:12 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.368s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149117743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Creating volume e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:12 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 1073741824 Nov 02 09:57:12 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de07ed08-80bc-44d4-8917-283d8f13c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e103595-7516-4622-8de1-fe4c7ca2a28b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedddd27-9528-4558-8ec6-c56cf60437f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (5d06d548-d96e-4509-95ab-b88b6fa6b1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3331bad-3796-4ee3-b261-0fb505938fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3331bad-3796-4ee3-b261-0fb505938fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58364496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947a110e-b107-4a29-a8cc-b9804dd98791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:13Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4685fc-bb8a-4590-9541-f35f6ace27ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4685fc-bb8a-4590-9541-f35f6ace27ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241da37f-2d24-42d8-8d24-dd0a5f01c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241da37f-2d24-42d8-8d24-dd0a5f01c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947a110e-b107-4a29-a8cc-b9804dd98791', 'volume_name': 'volume-947a110e-b107-4a29-a8cc-b9804dd98791', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f17c6d-e297-488f-99ec-9a7f9007e7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f17c6d-e297-488f-99ec-9a7f9007e7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7abc10d-6b74-4ad3-86e0-c71a17c99da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Volume 947a110e-b107-4a29-a8cc-b9804dd98791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947a110e-b107-4a29-a8cc-b9804dd98791', 'volume_size': 1} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Volume volume-7e103595-7516-4622-8de1-fe4c7ca2a28b (7e103595-7516-4622-8de1-fe4c7ca2a28b): created successfully Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedddd27-9528-4558-8ec6-c56cf60437f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Flow 'volume_create_manager' (6811c8c0-c360-48f2-95e5-8c483f33bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:12 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bdc55dec-a2b1-4917-97f2-c218a17c9679 tempest-VolumeDependencyTests-1893477816 None] Created volume successfully. Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (17f67db0-eb64-4057-ad14-f7978956d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7016181c-74a6-4957-9cbc-76a835e0c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:13 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 1073741824" returned: 0 in 0.788s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7016181c-74a6-4957-9cbc-76a835e0c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981448214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a4e5e8-0979-4e19-a111-9f3903b827e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:13Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3fe68d-1cfe-41c8-8ae3-14a21aff9905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3fe68d-1cfe-41c8-8ae3-14a21aff9905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775c95be-f17b-4ac8-8653-18506b6e3af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775c95be-f17b-4ac8-8653-18506b6e3af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a4e5e8-0979-4e19-a111-9f3903b827e6', 'volume_name': 'volume-99a4e5e8-0979-4e19-a111-9f3903b827e6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adf0c0b-d90c-4391-b0f4-c06dfe973007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adf0c0b-d90c-4391-b0f4-c06dfe973007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbb6b52-dc27-4453-9c13-356345daa58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Volume 99a4e5e8-0979-4e19-a111-9f3903b827e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a4e5e8-0979-4e19-a111-9f3903b827e6', 'volume_size': 1} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:13 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 Nov 02 09:57:13 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:13 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (ad909cd3-0445-4883-b557-ca5d5c7339df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:14 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb17bbc1-9488-4c74-953c-372cb48f71a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" returned: 0 in 0.428s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.857s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-109504645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Creating volume 90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:14 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb17bbc1-9488-4c74-953c-372cb48f71a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125727219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d08fd-2082-4ec6-acfa-49dbb7689cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:14Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 1073741824 Nov 02 09:57:14 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f31191e-d5d5-4734-b2ee-3b10a05bd809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f31191e-d5d5-4734-b2ee-3b10a05bd809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e524868-4cce-43af-8724-970f84937496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e524868-4cce-43af-8724-970f84937496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37d08fd-2082-4ec6-acfa-49dbb7689cfb', 'volume_name': 'volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27731d39-f170-42de-85a2-8ef862054aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27731d39-f170-42de-85a2-8ef862054aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c03ea6c-01d4-4f1c-800a-a790296c8908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Volume b37d08fd-2082-4ec6-acfa-49dbb7689cfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb', 'volume_size': 1} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64e135f-01aa-4d66-9043-3d151a62abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113fad78-dd17-42d8-8068-e1ad0f36f494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:14 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Volume volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 (e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28): created successfully Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113fad78-dd17-42d8-8068-e1ad0f36f494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (ab7fc6d5-2983-459e-af52-e65142096205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:14 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-81dbe88a-95d6-4e09-9bb4-d02f5090cc72 tempest-CreateVolumesFromImageTest-1311744890 None] Created volume successfully. Nov 02 09:57:14 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 1073741824" returned: 0 in 0.526s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:14 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 Nov 02 09:57:14 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:15 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.469s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864898089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dff57d-532a-4ae9-a311-8dcef49b10df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:12Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume b0dff57d-532a-4ae9-a311-8dcef49b10df {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:15 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fbdb42-e788-448b-8332-1cbed5f866f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94cf036-52bf-4fa1-9fb6-62f0cb06b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:15 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df 1073741824 Nov 02 09:57:15 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:15 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Volume volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 (90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6): created successfully Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94cf036-52bf-4fa1-9fb6-62f0cb06b047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (543598ed-d6c3-47f6-86bb-2e21f674064a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-045623bc-87d5-4ef2-9420-1f8a2ce1558b tempest-CreateVolumesFromImageTest-1311744890 None] Created volume successfully. Nov 02 09:57:15 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df 1073741824" returned: 0 in 0.639s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:15 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df Nov 02 09:57:15 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:16 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.144s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58364496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947a110e-b107-4a29-a8cc-b9804dd98791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:13Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Creating volume 947a110e-b107-4a29-a8cc-b9804dd98791 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:16 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b8da8b7-0ff8-4adf-a794-07f5b71ccdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dff57d-532a-4ae9-a311-8dcef49b10df', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:16 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 1073741824 Nov 02 09:57:16 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed0d89b-95e9-47ae-b5d6-ea9dd8fb467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:16 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-b0dff57d-532a-4ae9-a311-8dcef49b10df (b0dff57d-532a-4ae9-a311-8dcef49b10df): created successfully Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed0d89b-95e9-47ae-b5d6-ea9dd8fb467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (ba4970ba-2f46-4fcc-b815-f23e79e3321d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0612a76b-8ffb-4b75-bc76-9a40a865ae81 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:16 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 1073741824" returned: 0 in 0.626s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:16 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 Nov 02 09:57:16 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:17 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791" returned: 0 in 0.406s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981448214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a4e5e8-0979-4e19-a111-9f3903b827e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:13Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Creating volume 99a4e5e8-0979-4e19-a111-9f3903b827e6 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:17 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7abc10d-6b74-4ad3-86e0-c71a17c99da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947a110e-b107-4a29-a8cc-b9804dd98791', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 1073741824 Nov 02 09:57:17 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bca77e-d2f7-4777-bd55-e2fbee05af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Flow 'volume_create_manager' (74619467-74da-4fda-9b25-62efa258b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abbbe6f-0c06-4e97-b881-45be08eeeaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Volume volume-947a110e-b107-4a29-a8cc-b9804dd98791 (947a110e-b107-4a29-a8cc-b9804dd98791): created successfully Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7bca77e-d2f7-4777-bd55-e2fbee05af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (5d06d548-d96e-4509-95ab-b88b6fa6b1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abbbe6f-0c06-4e97-b881-45be08eeeaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0695593c-53fa-4062-ada2-7ffbec24d9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b57dd88cee94c39903d487fb4e66baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:17Z,use_quota=True,user_id='be8fa1ae0dd04a05a846cbbba5e98f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d75083-e829-4ba4-bb56-9fac23d1454a),volume_type_id=28d75083-e829-4ba4-bb56-9fac23d1454a)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a77702-d14e-48be-9d46-d7d74c04e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a77702-d14e-48be-9d46-d7d74c04e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188fd3de-6b55-429b-9cfa-0e52341efc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:57:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3db0a084-ebbe-47d1-84cb-fe12315cb28c tempest-CreateVolumesFromImageTest-1311744890 None] Created volume successfully. Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (803b33a9-2e5f-48a2-a9f6-d0916c126428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd89ddd-a70b-440a-ad6a-c668d2a31146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd89ddd-a70b-440a-ad6a-c668d2a31146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469035641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71bc976-ba29-41dc-90db-9c3f034acf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:17Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699881e4-d160-4ba6-9555-853c4dfbcd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699881e4-d160-4ba6-9555-853c4dfbcd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9736d5-368c-4e68-822b-85aea89056f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9736d5-368c-4e68-822b-85aea89056f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71bc976-ba29-41dc-90db-9c3f034acf7d', 'volume_name': 'volume-d71bc976-ba29-41dc-90db-9c3f034acf7d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb782c-d2bf-4929-8c45-2361413ca59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb782c-d2bf-4929-8c45-2361413ca59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7165ab4-c2fa-4ca4-9f98-9065ebc1fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume d71bc976-ba29-41dc-90db-9c3f034acf7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71bc976-ba29-41dc-90db-9c3f034acf7d', 'volume_size': 1} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (3da8b10f-1951-4972-aca3-126dae9cc456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b51d92-5927-4f87-94d0-86defbcceb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b51d92-5927-4f87-94d0-86defbcceb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471633580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd773e2-4dce-4cd7-aea5-0fec7c037a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:18Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5bd4c4-2c8a-4104-922b-08169bcd2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5bd4c4-2c8a-4104-922b-08169bcd2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d24ef3-cb87-48f1-be5f-e40cbfa3011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d24ef3-cb87-48f1-be5f-e40cbfa3011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd773e2-4dce-4cd7-aea5-0fec7c037a91', 'volume_name': 'volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684e0fed-1e6d-4510-adf6-32509e70b655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684e0fed-1e6d-4510-adf6-32509e70b655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd533987-03ce-475e-bb7f-84c700acff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:17 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume fdd773e2-4dce-4cd7-aea5-0fec7c037a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91', 'volume_size': 1} Nov 02 09:57:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:17 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 1073741824" returned: 0 in 0.785s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188fd3de-6b55-429b-9cfa-0e52341efc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0695593c-53fa-4062-ada2-7ffbec24d9de', 'volume_name': 'volume-0695593c-53fa-4062-ada2-7ffbec24d9de', 'volume_size': 1, 'image_id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c01b7723aee59238b50a7dbfc502371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57dd88cee94c39903d487fb4e66baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43b899444da3959f9a0ccbf1d31a2c814aea0a685d3a636d392d7cb2973deb587727cce6723cf78a8259ff441849ee96753299ac00f6123296507190e1b0c50c', 'id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c7a3fdf-0108-425e-8e92-d807cf28317c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65084278-7905-4b16-9dd1-13b94ca49f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65084278-7905-4b16-9dd1-13b94ca49f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3118ac0d-261d-48ae-ac8d-dc3c58dfe981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Volume 0695593c-53fa-4062-ada2-7ffbec24d9de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0695593c-53fa-4062-ada2-7ffbec24d9de', 'volume_size': 1, 'image_id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c01b7723aee59238b50a7dbfc502371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57dd88cee94c39903d487fb4e66baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43b899444da3959f9a0ccbf1d31a2c814aea0a685d3a636d392d7cb2973deb587727cce6723cf78a8259ff441849ee96753299ac00f6123296507190e1b0c50c', 'id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c7a3fdf-0108-425e-8e92-d807cf28317c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Trying to clone 0695593c-53fa-4062-ada2-7ffbec24d9de from image 1c7a3fdf-0108-425e-8e92-d807cf28317c at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:18 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 Nov 02 09:57:18 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Image download 0.00 MB at 0.00 MB/s Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[92db7ef2-d6d9-444b-8488-78435036cacc]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:18 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6" returned: 0 in 0.382s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.317s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125727219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37d08fd-2082-4ec6-acfa-49dbb7689cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead9739079384ca7baec4452ab2b6684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:14Z,use_quota=True,user_id='f724969fdff84addb991aec6fbfda831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Creating volume b37d08fd-2082-4ec6-acfa-49dbb7689cfb {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:18 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:18 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:18 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb 1073741824 Nov 02 09:57:18 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (f488975f-05b5-4ffe-9316-32b615fff3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b71de3-a1a4-4a8f-bdba-03989705ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbb6b52-dc27-4453-9c13-356345daa58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a4e5e8-0979-4e19-a111-9f3903b827e6', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ab2230-81d8-45e5-a5b0-7db9d71574ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b71de3-a1a4-4a8f-bdba-03989705ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309969171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b749c56b-05c6-45d5-8a38-6c61deb8c5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:18Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a983801-be34-42f3-923d-5dcf48ae35e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a983801-be34-42f3-923d-5dcf48ae35e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799dbbc6-8aa2-4568-a0df-47527298b3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799dbbc6-8aa2-4568-a0df-47527298b3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b749c56b-05c6-45d5-8a38-6c61deb8c5cd', 'volume_name': 'volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5a118b-2309-4870-9345-298cb0126964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5a118b-2309-4870-9345-298cb0126964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f331c95c-fe1a-4989-88ac-af1d11bab4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume b749c56b-05c6-45d5-8a38-6c61deb8c5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd', 'volume_size': 1} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Volume volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 (99a4e5e8-0979-4e19-a111-9f3903b827e6): created successfully Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ab2230-81d8-45e5-a5b0-7db9d71574ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (17f67db0-eb64-4057-ad14-f7978956d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:18 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ec3ab757-40fa-46da-9184-2fc0795f5db7 tempest-CreateVolumesFromImageTest-1311744890 None] Created volume successfully. Nov 02 09:57:18 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:18 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (0b355e5b-b055-4ef1-bbfd-6f99d7742954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8004794c-0557-4a25-9172-dfb136183ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8004794c-0557-4a25-9172-dfb136183ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709919296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01658a38-9afa-41bd-9d7c-2a6de5cd2d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:19Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349704a6-feec-4eab-b480-f334c684c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349704a6-feec-4eab-b480-f334c684c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef2010-8906-49bf-96e8-d1727f1be143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef2010-8906-49bf-96e8-d1727f1be143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01658a38-9afa-41bd-9d7c-2a6de5cd2d41', 'volume_name': 'volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44d131-7415-4dfa-9ea9-597e4b6a4b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44d131-7415-4dfa-9ea9-597e4b6a4b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c36d74-64c7-42a7-824c-7f90a03a7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume 01658a38-9afa-41bd-9d7c-2a6de5cd2d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41', 'volume_size': 1} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:19 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Temporary image 1c7a3fdf-0108-425e-8e92-d807cf28317c is fetched for user be8fa1ae0dd04a05a846cbbba5e98f4c. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:57:19 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb 1073741824" returned: 0 in 0.740s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:19 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb Nov 02 09:57:19 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b8bb8e-ec99-49fb-b982-a7aad64eff04]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:19 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:19 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (1194f6a9-a57c-4190-8401-8b9c328f0cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefc3d99-d579-43d7-8479-7b93b0775cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefc3d99-d579-43d7-8479-7b93b0775cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849125189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f1d265-8442-483d-bcae-56d7e6e76a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:19Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbb80e-60fb-451f-8b60-04ae2027f564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbb80e-60fb-451f-8b60-04ae2027f564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934432be-ffe6-45b5-854d-57df63b5cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934432be-ffe6-45b5-854d-57df63b5cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f1d265-8442-483d-bcae-56d7e6e76a7a', 'volume_name': 'volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0984bb3c-aa86-401e-bd8e-b533a05e4a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0984bb3c-aa86-401e-bd8e-b533a05e4a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9844ad-d4f2-448e-ad59-acc61401a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume e6f1d265-8442-483d-bcae-56d7e6e76a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a', 'volume_size': 1} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:19 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.449s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c03ea6c-01d4-4f1c-800a-a790296c8908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f877c8d-ae73-48a7-bb4e-b2e5207b9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Creating offline snapshot 5df54a2e-04a4-4e45-ac3c-386ce18c8b18 of volume 7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:57:19 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Volume volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb (b37d08fd-2082-4ec6-acfa-49dbb7689cfb): created successfully Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f877c8d-ae73-48a7-bb4e-b2e5207b9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Flow 'volume_create_manager' (ad909cd3-0445-4883-b557-ca5d5c7339df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15a18a-0a7f-4069-b380-02da624cd9f6]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:19 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f156b069-c0af-41e0-86f5-3588e16c47ca tempest-CreateVolumesFromImageTest-1311744890 None] Created volume successfully. Nov 02 09:57:19 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:19 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:19 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:19 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:19 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:20 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:20 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.441s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:20 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 1G Nov 02 09:57:20 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:20 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 1G" returned: 0 in 0.490s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e103595-7516-4622-8de1-fe4c7ca2a28b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:20 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e103595-7516-4622-8de1-fe4c7ca2a28b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:20 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-b37d08fd-2082-4ec6-acfa-49dbb7689cfb-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-b37d08fd-2082-4ec6-acfa-49dbb7689cfb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-quobyte-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc72561-f31a-4d5e-9516-992b32d9dd1b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e103595-7516-4622-8de1-fe4c7ca2a28b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.378s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:21 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 is being set with open permissions: ugo+rw Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:21 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:21 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb Nov 02 09:57:21 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:21 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.292s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:21 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:21 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb Nov 02 09:57:21 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:21 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info" returned: 0 in 0.330s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:21 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info is being set with open permissions: ugo+rw Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info Nov 02 09:57:21 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:21 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" returned: 0 in 0.350s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-b37d08fd-2082-4ec6-acfa-49dbb7689cfb" released by "delete_volume" :: held 0.845s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Created reservations ['1cca68a2-6cf4-457a-9c7f-3724966e5a01', '46cfe178-c78f-40b4-a718-22b82428b046', '63ace72d-cb5f-4799-a5ba-13f442c2e359', '32796172-5981-4564-9d24-12f2d29bf04a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:21 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.info" returned: 0 in 0.300s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:22 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:22 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.373s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1469035641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71bc976-ba29-41dc-90db-9c3f034acf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:17Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume d71bc976-ba29-41dc-90db-9c3f034acf7d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:22 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-99a4e5e8-0979-4e19-a111-9f3903b827e6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:22 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d 1073741824 Nov 02 09:57:22 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-99a4e5e8-0979-4e19-a111-9f3903b827e6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5fa8bd84-6cb7-43e5-a844-bc5e746e0c71 tempest-VolumeDependencyTests-1893477816 None] Create snapshot completed successfully Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-quobyte-99a4e5e8-0979-4e19-a111-9f3903b827e6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-99a4e5e8-0979-4e19-a111-9f3903b827e6" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1413320c-2331-4c88-99ae-9df911596c8a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:22 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.371s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Deleted volume successfully. Nov 02 09:57:22 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 Nov 02 09:57:22 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-747c9909-9f5f-4b2f-b1e7-f23c885e37aa tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-b37d08fd-2082-4ec6-acfa-49dbb7689cfb-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:22 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d 1073741824" returned: 0 in 0.661s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:22 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6" returned: 0 in 0.498s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:22 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6 Nov 02 09:57:22 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:22 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d Nov 02 09:57:22 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:23 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:23 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-99a4e5e8-0979-4e19-a111-9f3903b827e6" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d" returned: 0 in 0.314s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-99a4e5e8-0979-4e19-a111-9f3903b827e6" released by "delete_volume" :: held 0.907s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.123s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1471633580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd773e2-4dce-4cd7-aea5-0fec7c037a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:18Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume fdd773e2-4dce-4cd7-aea5-0fec7c037a91 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:23 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 1073741824 Nov 02 09:57:23 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7165ab4-c2fa-4ca4-9f98-9065ebc1fbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71bc976-ba29-41dc-90db-9c3f034acf7d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fddba70-efee-4734-a88d-f3bdf9ce84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-d71bc976-ba29-41dc-90db-9c3f034acf7d (d71bc976-ba29-41dc-90db-9c3f034acf7d): created successfully Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fddba70-efee-4734-a88d-f3bdf9ce84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (803b33a9-2e5f-48a2-a9f6-d0916c126428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ac0e768f-5837-4b90-b45c-323926e76646 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Created reservations ['ea6ab04c-ddd6-4949-ac7f-189c5a551cc1', '57220ead-f43c-42c5-8cdd-576b6493d911', '14ce59ac-c486-48b9-84d0-60ab572cdbc2', '156bb682-e839-4ec0-a83b-5fb95ccaddae'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:23 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:23 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Flow 'volume_create_manager' (da5ea7c6-4ffd-440b-a134-b3bc92fcaf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c83fc1-02e3-457f-abc5-edef31c9516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c83fc1-02e3-457f-abc5-edef31c9516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1011108594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23839b9d-b52c-4517-b193-82487d30e5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='895b215011ac47c7892eaba949e19fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5df54a2e-04a4-4e45-ac3c-386ce18c8b18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:23Z,use_quota=True,user_id='b45ceacc7cdf4ebd9a9de2df9835f8ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d54811-c64a-45b3-a033-d096a6165e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d54811-c64a-45b3-a033-d096a6165e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f57f7e-bc58-4a03-81e8-c7c52ffe4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f57f7e-bc58-4a03-81e8-c7c52ffe4455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23839b9d-b52c-4517-b193-82487d30e5bc', 'volume_name': 'volume-23839b9d-b52c-4517-b193-82487d30e5bc', 'volume_size': 1, 'snapshot_id': '5df54a2e-04a4-4e45-ac3c-386ce18c8b18'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb6106e-78e9-4076-a8b5-ed409ee9103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb6106e-78e9-4076-a8b5-ed409ee9103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca9551f-69ec-4e4c-a774-41d675e43a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Volume 23839b9d-b52c-4517-b193-82487d30e5bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23839b9d-b52c-4517-b193-82487d30e5bc', 'volume_size': 1, 'snapshot_id': '5df54a2e-04a4-4e45-ac3c-386ce18c8b18'} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:23 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Deleted volume successfully. Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-069b03f3-25dd-4092-8aca-0fdddf0f3631 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-99a4e5e8-0979-4e19-a111-9f3903b827e6-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:23 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 1073741824" returned: 0 in 0.664s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:23 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 Nov 02 09:57:23 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:24 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" returned: 0 in 0.277s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.422s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1309969171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b749c56b-05c6-45d5-8a38-6c61deb8c5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:18Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume b749c56b-05c6-45d5-8a38-6c61deb8c5cd {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:24 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd533987-03ce-475e-bb7f-84c700acff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:24 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd 1073741824 Nov 02 09:57:24 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91681d4-dc04-4f47-9864-a4dea7da0dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:24 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 (fdd773e2-4dce-4cd7-aea5-0fec7c037a91): created successfully Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91681d4-dc04-4f47-9864-a4dea7da0dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (3da8b10f-1951-4972-aca3-126dae9cc456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ef4976bd-f59c-470a-ba9c-1c797918c175 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-947a110e-b107-4a29-a8cc-b9804dd98791-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-947a110e-b107-4a29-a8cc-b9804dd98791-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-quobyte-947a110e-b107-4a29-a8cc-b9804dd98791" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-947a110e-b107-4a29-a8cc-b9804dd98791" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1bd29-dd73-49d6-8708-e6c5a66e198a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:24 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 Nov 02 09:57:24 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:24 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd 1073741824" returned: 0 in 0.628s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:24 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd Nov 02 09:57:24 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791" returned: 0 in 0.516s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791 Nov 02 09:57:25 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1709919296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01658a38-9afa-41bd-9d7c-2a6de5cd2d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:19Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume 01658a38-9afa-41bd-9d7c-2a6de5cd2d41 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:25 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f331c95c-fe1a-4989-88ac-af1d11bab4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:25 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 1073741824 Nov 02 09:57:25 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee36ca-0712-43c7-9566-d8ae4ea90654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd (b749c56b-05c6-45d5-8a38-6c61deb8c5cd): created successfully Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bee36ca-0712-43c7-9566-d8ae4ea90654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (f488975f-05b5-4ffe-9316-32b615fff3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7770212c-d42f-46df-bac7-81d19fd1e927 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:25 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-947a110e-b107-4a29-a8cc-b9804dd98791" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-947a110e-b107-4a29-a8cc-b9804dd98791" released by "delete_volume" :: held 0.882s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Created reservations ['76218434-cf6a-4623-b1ba-41afceab21a5', '6aaa452c-821b-4b5d-8e8f-691553d6eda4', 'b25b2c4f-65b1-44d1-a213-47f79a52aa9c', '6c288e9b-64a3-4481-9bb1-18872186c284'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:25 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:25 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 1073741824" returned: 0 in 0.648s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-quobyte-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1d3e3-50d6-401f-9a45-e751ae8389fa]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:25 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 Nov 02 09:57:25 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:25 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:25 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Deleted volume successfully. Nov 02 09:57:25 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 Nov 02 09:57:25 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-438dc621-d017-4c55-9c5e-66b5f200474a tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-947a110e-b107-4a29-a8cc-b9804dd98791-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:26 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.583s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1849125189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f1d265-8442-483d-bcae-56d7e6e76a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12f1699b49f043999324a1cf909127b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:19Z,use_quota=True,user_id='cb2628e64dc945a084fda8a49e92c39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Creating volume e6f1d265-8442-483d-bcae-56d7e6e76a7a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:26 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a 1073741824 Nov 02 09:57:26 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c36d74-64c7-42a7-824c-7f90a03a7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be27206-ffae-4d34-9f5b-5427c3534fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:26 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 (01658a38-9afa-41bd-9d7c-2a6de5cd2d41): created successfully Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be27206-ffae-4d34-9f5b-5427c3534fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (0b355e5b-b055-4ef1-bbfd-6f99d7742954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:26 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" returned: 0 in 0.460s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1a236d89-1e78-41dc-982d-287535303b43 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:26 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6 Nov 02 09:57:26 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6" released by "delete_volume" :: held 0.803s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Created reservations ['efdaf93e-8ded-4aa9-9665-f00e132b68db', '85b42e28-fe12-4f37-a381-59c001d517c8', '61b27235-e527-423e-a171-f7b10837eb63', '780cdd06-5516-4a03-aa81-bec1b671f410'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:26 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a 1073741824" returned: 0 in 0.572s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:26 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:26 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:26 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a Nov 02 09:57:26 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:26 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "cinder-quobyte-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" acquired by "delete_volume" :: waited 0.046s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6654c5-4265-4ac1-97a4-c062b0f24506]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.384s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Deleted volume successfully. Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b5e7a4c1-db4d-4514-b65c-6ebff4acbd0f tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-90b4b9ae-4a1c-4ac8-8b71-8dfa384b09b6-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:27 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a" returned: 0 in 0.416s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:27 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.163s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0695593c-53fa-4062-ada2-7ffbec24d9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b57dd88cee94c39903d487fb4e66baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:17Z,use_quota=True,user_id='be8fa1ae0dd04a05a846cbbba5e98f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d75083-e829-4ba4-bb56-9fac23d1454a),volume_type_id=28d75083-e829-4ba4-bb56-9fac23d1454a)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Creating volume 0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:27 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9844ad-d4f2-448e-ad59-acc61401a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:27 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1073741824 Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff70314-c389-4fb7-89e6-b7bcd5ac64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:27 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Volume volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a (e6f1d265-8442-483d-bcae-56d7e6e76a7a): created successfully Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff70314-c389-4fb7-89e6-b7bcd5ac64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Flow 'volume_create_manager' (1194f6a9-a57c-4190-8401-8b9c328f0cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-697cd066-2134-43bd-a905-0412c4f40000 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created volume successfully. Nov 02 09:57:27 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" returned: 0 in 0.499s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28 Nov 02 09:57:27 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1073741824" returned: 0 in 0.482s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:27 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de Nov 02 09:57:27 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:27 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:27 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-quobyte-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28" released by "delete_volume" :: held 0.919s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Created reservations ['3af9e9c4-e8f3-4cb1-aabd-f294dca86a5f', '0f154de3-7c8a-4c45-b08c-52bdd50a6d6b', '0019f644-57c6-4429-9294-f03a3b75bdf9', 'b7b665ca-aa4f-4c1b-951c-0ce408df66dc'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de" returned: 0 in 0.319s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.572s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-23839b9d-b52c-4517-b193-82487d30e5bc" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:28 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:28 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-23839b9d-b52c-4517-b193-82487d30e5bc" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Creating volume 23839b9d-b52c-4517-b193-82487d30e5bc from snapshot 5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Attempting download of 1c7a3fdf-0108-425e-8e92-d807cf28317c ((None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}])) to volume 0695593c-53fa-4062-ada2-7ffbec24d9de. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] snapshot: 5df54a2e-04a4-4e45-ac3c-386ce18c8b18, volume: 23839b9d-b52c-4517-b193-82487d30e5bc, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec6b1a9-ed40-4144-a5d5-043efb802727]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c319ece-e1cd-4d88-a649-56ec1971c494]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:28 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue Nov 02 09:57:28 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Deleted volume successfully. Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-e6f1d265-8442-483d-bcae-56d7e6e76a7a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-50bffee5-0ba5-4529-9874-34b8c7fd5801 tempest-CreateVolumesFromImageTest-1311744890 None] Lock "cinder-e3a8e0b6-ec6c-429e-b51b-a4ea8526fd28-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-e6f1d265-8442-483d-bcae-56d7e6e76a7a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-e6f1d265-8442-483d-bcae-56d7e6e76a7a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-e6f1d265-8442-483d-bcae-56d7e6e76a7a" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2014b0-5bad-4cc4-8dd7-5990287792a5]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue" returned: 0 in 0.456s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a Nov 02 09:57:28 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.512s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e103595-7516-4622-8de1-fe4c7ca2a28b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77ad20-df5a-40a8-b337-a8f98eb3d758]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:28 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue Nov 02 09:57:28 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:28 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:28 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:29 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a Nov 02 09:57:29 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue" returned: 1 in 0.385s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c7a3fdf-0108-425e-8e92-d807cf28317c_2e7173ue' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcb2f7-294e-4e5d-b2e2-d653c9e08a6e]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:29 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:29 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.473s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:29 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc Nov 02 09:57:29 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-e6f1d265-8442-483d-bcae-56d7e6e76a7a" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-e6f1d265-8442-483d-bcae-56d7e6e76a7a" released by "delete_volume" :: held 0.799s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['aaa3ebcd-3d59-4d33-b61f-1af5d5de4aa2', 'cefc6677-35e3-4af0-a85a-17aa2fc546d0', 'd9445bc7-f894-4979-82ad-e9d35944d862', '1c0a07d8-8844-40c6-bb97-2efb36bec771'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:29 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:29 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:29 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD Nov 02 09:57:29 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-01658a38-9afa-41bd-9d7c-2a6de5cd2d41-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-01658a38-9afa-41bd-9d7c-2a6de5cd2d41-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" acquired by "delete_volume" :: waited 0.043s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d44ed-73a3-4289-8166-7ed54e9db471]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:30 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD" returned: 1 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] 1c7a3fdf-0108-425e-8e92-d807cf28317c was raw, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:30 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de Nov 02 09:57:30 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:30 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.601s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:30 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 Nov 02 09:57:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:30 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-442489cf-34c2-47c9-8f92-a6928ca38cec tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-e6f1d265-8442-483d-bcae-56d7e6e76a7a-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:30 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" returned: 0 in 0.982s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:31 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41 Nov 02 09:57:31 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:31 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de" returned: 0 in 1.327s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c7a3fdf-0108-425e-8e92-d807cf28317c_dfehvpnodevstack@QuobyteHD, size 0.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:57:31 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:31 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1G Nov 02 09:57:31 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:31 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" returned: 0 in 0.571s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-01658a38-9afa-41bd-9d7c-2a6de5cd2d41" released by "delete_volume" :: held 1.635s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:31 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['7687e0d5-8c32-4d45-946b-e6ab49d23c87', 'd6d3a4c2-5a44-4a14-803d-03fb3f2d96b7', '609e92f5-9771-4623-afbd-8d17d7d3a12b', '24e06f9c-6001-4574-8367-fb2d143716f0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:32 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:32 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-b749c56b-05c6-45d5-8a38-6c61deb8c5cd-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-b749c56b-05c6-45d5-8a38-6c61deb8c5cd-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:32 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.603s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:32 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de 1G" returned: 0 in 1.162s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Downloaded image 1c7a3fdf-0108-425e-8e92-d807cf28317c ((None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}])) to volume 0695593c-53fa-4062-ada2-7ffbec24d9de successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Temporary image 1c7a3fdf-0108-425e-8e92-d807cf28317c for user be8fa1ae0dd04a05a846cbbba5e98f4c is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Marking volume 0695593c-53fa-4062-ada2-7ffbec24d9de as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Copying metadata from image 1c7a3fdf-0108-425e-8e92-d807cf28317c to 0695593c-53fa-4062-ada2-7ffbec24d9de. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Creating volume glance metadata for volume 0695593c-53fa-4062-ada2-7ffbec24d9de backed by image 1c7a3fdf-0108-425e-8e92-d807cf28317c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8c01b7723aee59238b50a7dbfc502371', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdc534-91a9-4065-a549-4717aafc8ab0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cb652bcb-27d0-426e-8374-a68afc9d2fe9 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-01658a38-9afa-41bd-9d7c-2a6de5cd2d41-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3118ac0d-261d-48ae-ac8d-dc3c58dfe981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0695593c-53fa-4062-ada2-7ffbec24d9de', 'volume_size': 1, 'image_id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c7a3fdf-0108-425e-8e92-d807cf28317c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c01b7723aee59238b50a7dbfc502371', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8b57dd88cee94c39903d487fb4e66baa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43b899444da3959f9a0ccbf1d31a2c814aea0a685d3a636d392d7cb2973deb587727cce6723cf78a8259ff441849ee96753299ac00f6123296507190e1b0c50c', 'id': '1c7a3fdf-0108-425e-8e92-d807cf28317c', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c7a3fdf-0108-425e-8e92-d807cf28317c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04813ad3-4f3f-4390-9106-70074f87484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:32 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Volume volume-0695593c-53fa-4062-ada2-7ffbec24d9de (0695593c-53fa-4062-ada2-7ffbec24d9de): created successfully Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04813ad3-4f3f-4390-9106-70074f87484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Flow 'volume_create_manager' (74619467-74da-4fda-9b25-62efa258b32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-289c21b7-7c95-4aac-9f52-61748641d774 tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Created volume successfully. Nov 02 09:57:33 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd Nov 02 09:57:33 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Acquiring lock "cinder-0695593c-53fa-4062-ada2-7ffbec24d9de-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "cinder-0695593c-53fa-4062-ada2-7ffbec24d9de-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:33 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Acquiring lock "cinder-quobyte-0695593c-53fa-4062-ada2-7ffbec24d9de" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" returned: 0 in 1.128s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "cinder-quobyte-0695593c-53fa-4062-ada2-7ffbec24d9de" acquired by "delete_volume" :: waited 0.050s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:33 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd Nov 02 09:57:33 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f20e8-b18f-4d3b-94d9-440fdc41682f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:34 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de Nov 02 09:57:34 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:34 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" returned: 0 in 0.492s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-b749c56b-05c6-45d5-8a38-6c61deb8c5cd" released by "delete_volume" :: held 1.741s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['9da9f1ca-2eb9-4da0-8459-4f194d2febf8', 'ec72dd61-6e09-4a03-90c6-4d9652e884ea', '76fdf401-2c6d-429a-aa14-96ddcf3e9024', '54028032-1420-4d92-bd0a-bda90975d884'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:34 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:34 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:35 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de" returned: 0 in 1.115s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:35 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de Nov 02 09:57:35 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-fdd773e2-4dce-4cd7-aea5-0fec7c037a91-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-fdd773e2-4dce-4cd7-aea5-0fec7c037a91-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aecfd5-8742-4a4e-ab5d-16b000f2b6bb]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:35 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.785s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:35 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1b0bcbf3-8ce4-46e3-a37b-b194f3d82679 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-b749c56b-05c6-45d5-8a38-6c61deb8c5cd-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:35 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:35 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 Nov 02 09:57:35 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0695593c-53fa-4062-ada2-7ffbec24d9de" returned: 0 in 0.667s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "cinder-quobyte-0695593c-53fa-4062-ada2-7ffbec24d9de" released by "delete_volume" :: held 1.921s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:35 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Created reservations ['18ad8bd8-4333-4ba6-a006-e89ef9946e23', 'dadb6680-050f-42e5-b6a6-08f3292d6c9c', '490d5f04-54bf-4b65-8ecb-5b7f6594a563', '3dd5c565-ffa9-4c3c-b4a3-d44228d56d57'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:36 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:36 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:36 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" returned: 0 in 0.938s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:36 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91 Nov 02 09:57:36 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (ceff1aee-a69d-4e00-89bc-c45b451a5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b49059-e694-46e5-bf1e-8c3fa5f112b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:37 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b49059-e694-46e5-bf1e-8c3fa5f112b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619157901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b17060-f077-4280-8585-bf7daef60b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:37Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4c43a3-9fa1-4e33-b1db-a4df565f3542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4c43a3-9fa1-4e33-b1db-a4df565f3542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:37 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec6bb01-7ee4-4e39-bd72-443788988476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec6bb01-7ee4-4e39-bd72-443788988476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b17060-f077-4280-8585-bf7daef60b93', 'volume_name': 'volume-94b17060-f077-4280-8585-bf7daef60b93', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf057a0-12e4-44bb-95ea-6342a2e35f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf057a0-12e4-44bb-95ea-6342a2e35f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd0987-b504-432d-be4f-73dee7ddcd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume 94b17060-f077-4280-8585-bf7daef60b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b17060-f077-4280-8585-bf7daef60b93', 'volume_size': 1} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.940s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" returned: 0 in 0.704s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Deleted volume successfully. Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-fdd773e2-4dce-4cd7-aea5-0fec7c037a91" released by "delete_volume" :: held 1.775s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fe63ae79-d4e3-4de3-84ce-81a79994c2ba tempest-VolumeAndVolumeTypeFromImageTest-1414164737 None] Lock "cinder-0695593c-53fa-4062-ada2-7ffbec24d9de-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['8e7a1e89-16e2-4d37-829b-1d90b13b16ab', '45382c9b-18e4-4acc-bd14-931dff178e74', '640dd53d-aa58-48d7-bf8f-ec10af2460d4', 'de47c7fa-f304-4a14-a169-2f92559908c0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:37 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:37 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-d71bc976-ba29-41dc-90db-9c3f034acf7d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-d71bc976-ba29-41dc-90db-9c3f034acf7d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-d71bc976-ba29-41dc-90db-9c3f034acf7d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-d71bc976-ba29-41dc-90db-9c3f034acf7d" acquired by "delete_volume" :: waited 0.045s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:38 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.582s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a97e09f-6542-4a37-9613-f972a88a7011]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-3889116a-8228-4384-b10a-d94b7d4dbaf3 tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-fdd773e2-4dce-4cd7-aea5-0fec7c037a91-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:38 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d Nov 02 09:57:38 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:39 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d" returned: 0 in 0.998s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:39 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc" returned: 0 in 9.823s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:57:39 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Converted 1024.00 MB image at 104.22 MB/s Nov 02 09:57:39 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc is being set with open permissions: ugo+rw Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:39 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d Nov 02 09:57:39 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:39 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc Nov 02 09:57:39 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:39 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc" returned: 0 in 0.265s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" released by "_copy_volume_from_snapshot" :: held 11.219s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:39 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d71bc976-ba29-41dc-90db-9c3f034acf7d" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-d71bc976-ba29-41dc-90db-9c3f034acf7d" released by "delete_volume" :: held 1.428s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-23839b9d-b52c-4517-b193-82487d30e5bc" released by "_create_volume_from_snapshot" :: held 11.329s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.353s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.358s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619157901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b17060-f077-4280-8585-bf7daef60b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:37Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume 94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:39 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:39 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 1073741824 Nov 02 09:57:39 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca9551f-69ec-4e4c-a774-41d675e43a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23839b9d-b52c-4517-b193-82487d30e5bc', 'volume_size': 1, 'snapshot_id': '5df54a2e-04a4-4e45-ac3c-386ce18c8b18'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0cda15-876c-4548-94fa-ea4ac971ef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['0f1be996-3397-4d5e-8a07-0497f8516c31', 'ffdfaa6e-8a78-4a9b-a125-ec7328f9061e', 'ad9f9313-3c97-4baf-b5b3-d872be304c8c', 'c8aa3445-0e94-4ee5-afea-c0365f4d0c12'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Volume volume-23839b9d-b52c-4517-b193-82487d30e5bc (23839b9d-b52c-4517-b193-82487d30e5bc): created successfully Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0cda15-876c-4548-94fa-ea4ac971ef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Flow 'volume_create_manager' (da5ea7c6-4ffd-440b-a134-b3bc92fcaf99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:39 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-72850e64-1fab-4b46-95d3-fe1807c0e536 tempest-VolumeDependencyTests-1893477816 None] Created volume successfully. Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:39 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:39 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:40 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.330s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f36cb5f1-4752-4675-88fb-47691930582a tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-d71bc976-ba29-41dc-90db-9c3f034acf7d-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:40 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 1073741824" returned: 0 in 0.597s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:40 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 Nov 02 09:57:40 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-b0dff57d-532a-4ae9-a311-8dcef49b10df-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-b0dff57d-532a-4ae9-a311-8dcef49b10df-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "cinder-quobyte-b0dff57d-532a-4ae9-a311-8dcef49b10df" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-b0dff57d-532a-4ae9-a311-8dcef49b10df" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5967e-31c0-48d5-b1ae-99b25871f4b0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:40 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93" returned: 0 in 0.351s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fd0987-b504-432d-be4f-73dee7ddcd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b17060-f077-4280-8585-bf7daef60b93', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58c73d-c255-43bf-b6a5-77e8374c6ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:40 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df Nov 02 09:57:40 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-94b17060-f077-4280-8585-bf7daef60b93 (94b17060-f077-4280-8585-bf7daef60b93): created successfully Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be58c73d-c255-43bf-b6a5-77e8374c6ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (ceff1aee-a69d-4e00-89bc-c45b451a5223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a62b5dbd-7d9a-4f4d-87e6-43198e9e144a tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Deleting offline snapshot 5df54a2e-04a4-4e45-ac3c-386ce18c8b18 of volume 7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] snapshot_file for this snap is: volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9233a9e7-92bf-44ea-a851-e07a6777706c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:40 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:40 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:40 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df" returned: 0 in 0.555s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df Nov 02 09:57:41 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e103595-7516-4622-8de1-fe4c7ca2a28b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:57:41 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b0dff57d-532a-4ae9-a311-8dcef49b10df" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ee22c7-96f6-481b-a688-17c6c1c729d1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-quobyte-b0dff57d-532a-4ae9-a311-8dcef49b10df" released by "delete_volume" :: held 1.000s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Created reservations ['f95573ac-562a-4ed8-a382-5c50424af743', '2c979f8a-93cb-4268-9582-e737ad39ca8b', '5a2b12db-55a6-436d-8353-2f72abd09491', 'be4709a5-a80a-4e82-bef2-d9a1f2520648'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating offline snapshot acc8a86a-c8b3-4a91-83d4-b47c34e61532 of volume 94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:57:41 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:41 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42fe67-6233-45b7-bb7f-6a636ba5f8af]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:41 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:41 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:41 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 Nov 02 09:57:41 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.335s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:42 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Deleted volume successfully. Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0edb07bf-0319-4960-ae4b-a703e44fbe0d tempest-CreateVolumesFromSourceVolumeTest-530461457 None] Lock "cinder-b0dff57d-532a-4ae9-a311-8dcef49b10df-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:42 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93" returned: 0 in 0.551s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:42 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 1G Nov 02 09:57:42 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.850s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:42 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:42 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.426s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:42 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 1G" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b17060-f077-4280-8585-bf7daef60b93 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:42 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18 Nov 02 09:57:42 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b17060-f077-4280-8585-bf7daef60b93 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 Nov 02 09:57:42 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:42 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b.5df54a2e-04a4-4e45-ac3c-386ce18c8b18" returned: 0 in 0.337s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-5df54a2e-04a4-4e45-ac3c-386ce18c8b18" released by "_delete_snapshot" :: held 2.252s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" released by "delete_snapshot" :: held 2.283s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:43 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94b17060-f077-4280-8585-bf7daef60b93 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532" returned: 0 in 0.432s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 is being set with open permissions: ugo+rw Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:43 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 Nov 02 09:57:43 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Created reservations ['6b24da20-024b-4981-8809-dea6b4794fea', 'ec58ab51-e0d1-44db-af1d-14be946f906c', '1759e74f-745f-4cb8-b9fb-0718cffc8736', 'ecfc0152-7f17-4335-a002-38fb9d2c0ab3'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Delete snapshot completed successfully. Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-58637206-65e4-4c23-a06f-b6781047eb53 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-5df54a2e-04a4-4e45-ac3c-386ce18c8b18-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:43 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532" returned: 0 in 0.367s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:43 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info Nov 02 09:57:43 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:43 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info" returned: 0 in 0.285s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:43 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info is being set with open permissions: ugo+rw Nov 02 09:57:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:43 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info Nov 02 09:57:43 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:44 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.info" returned: 0 in 0.284s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-7e103595-7516-4622-8de1-fe4c7ca2a28b-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-7e103595-7516-4622-8de1-fe4c7ca2a28b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c3de6e0b-7912-4d2d-9249-3cfb8ffa52c0 tempest-CreateVolumesFromSnapshotTest-476441955 None] Create snapshot completed successfully Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[01598e2f-eea7-4daa-b24c-9cb98a6572db]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:44 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:44 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.453s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:44 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b Nov 02 09:57:44 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:45 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-7e103595-7516-4622-8de1-fe4c7ca2a28b" returned: 0 in 0.352s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-7e103595-7516-4622-8de1-fe4c7ca2a28b" released by "delete_volume" :: held 0.899s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Created reservations ['0b1a1c4b-5c86-4037-8117-552d484bfd87', '2f6a5658-9f74-4ff0-bbd3-475a87cc067a', '69d032be-0cf8-4153-938f-d0874a46869b', 'd91c50b6-9339-4fc7-8f01-5f0d035bfe4b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:45 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:45 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (7e794e13-6e03-423c-8053-8252ac3510b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281effe-7031-4585-871a-0073947f9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b281effe-7031-4585-871a-0073947f9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110586512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6994ced-9892-423f-899a-e5d92b026772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:45Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ece8fd-9ab1-4ca4-8e68-55dfda519443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ece8fd-9ab1-4ca4-8e68-55dfda519443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2ea35e-1961-447a-874c-23a6bb839375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2ea35e-1961-447a-874c-23a6bb839375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6994ced-9892-423f-899a-e5d92b026772', 'volume_name': 'volume-d6994ced-9892-423f-899a-e5d92b026772', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c98ca4-570b-4831-abea-5fb1f4724074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c98ca4-570b-4831-abea-5fb1f4724074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f01311c-7045-45db-985c-8bc775e4c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume d6994ced-9892-423f-899a-e5d92b026772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6994ced-9892-423f-899a-e5d92b026772', 'volume_size': 1} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-110586512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6994ced-9892-423f-899a-e5d92b026772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:45Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume d6994ced-9892-423f-899a-e5d92b026772 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:45 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 1073741824 Nov 02 09:57:45 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:45 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Deleted volume successfully. Nov 02 09:57:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bd1f87a1-6716-4046-a120-6370acc46360 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-7e103595-7516-4622-8de1-fe4c7ca2a28b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (9c31b3cd-2a3d-4303-9964-e7a9f1557eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8d8180-d968-4f9a-a9ba-669db0de25da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8d8180-d968-4f9a-a9ba-669db0de25da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363618931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ecc70e-0fc3-4cb7-8500-566fd2a803b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:46Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4afe35b-53a6-4acf-a0f7-51ce013e567e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4afe35b-53a6-4acf-a0f7-51ce013e567e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1ae170-361e-4951-ac3b-6aab08db5e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1ae170-361e-4951-ac3b-6aab08db5e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ecc70e-0fc3-4cb7-8500-566fd2a803b1', 'volume_name': 'volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9694f7ad-af3f-487a-b3b0-8bfadf60faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9694f7ad-af3f-487a-b3b0-8bfadf60faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998f9c1c-b001-4f06-bb25-4045921f8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume a0ecc70e-0fc3-4cb7-8500-566fd2a803b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1', 'volume_size': 1} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:46 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 1073741824" returned: 0 in 0.959s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:46 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 Nov 02 09:57:46 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-23839b9d-b52c-4517-b193-82487d30e5bc-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-23839b9d-b52c-4517-b193-82487d30e5bc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (5b4f04cd-8d10-4032-825c-20f7852d92f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfac44fe-3e98-45a2-855a-bf53879df033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfac44fe-3e98-45a2-855a-bf53879df033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511530821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d86fbaf-a399-4600-bf1b-c9a971d43227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:47Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de12fcb6-d588-4eb4-aa7b-ff6af9b596eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de12fcb6-d588-4eb4-aa7b-ff6af9b596eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1a2ddc-b160-4e40-8038-43af92d9b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1a2ddc-b160-4e40-8038-43af92d9b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d86fbaf-a399-4600-bf1b-c9a971d43227', 'volume_name': 'volume-8d86fbaf-a399-4600-bf1b-c9a971d43227', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faacf4d2-05ed-4c1a-8789-093b3c689210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faacf4d2-05ed-4c1a-8789-093b3c689210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7bea9c-cb9c-4b40-805a-9e7c8e188d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume 8d86fbaf-a399-4600-bf1b-c9a971d43227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d86fbaf-a399-4600-bf1b-c9a971d43227', 'volume_size': 1} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" acquired by "delete_volume" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[93807f2c-10e4-4c68-a622-e2e535174906]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Flow 'volume_create_manager' (805972d5-8b19-428c-9cfa-5251efd2f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:47 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04656533-35d7-4130-91e9-7eb5103bd7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772" returned: 0 in 0.569s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1363618931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ecc70e-0fc3-4cb7-8500-566fd2a803b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:46Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f01311c-7045-45db-985c-8bc775e4c98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6994ced-9892-423f-899a-e5d92b026772', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d3e47f-cb78-4bb0-9a88-47653fc62cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04656533-35d7-4130-91e9-7eb5103bd7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dba9bc-83bb-4a76-9dc1-64ff5cf68761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe9f771d6c49eeba75acdf71813880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:47Z,use_quota=True,user_id='67579ba819a546a78ebbcb5b0f0c1ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 1073741824 Nov 02 09:57:47 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28ae02-d92b-446c-afeb-5cac7ce600d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28ae02-d92b-446c-afeb-5cac7ce600d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb6f743-78a0-4ae2-b122-7c2b6c06f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc Nov 02 09:57:47 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb6f743-78a0-4ae2-b122-7c2b6c06f087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16dba9bc-83bb-4a76-9dc1-64ff5cf68761', 'volume_name': 'volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4e0185-44d1-498f-8674-0bdfb9f0f448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4e0185-44d1-498f-8674-0bdfb9f0f448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3d96f6-fcc6-42d1-8efe-4eadba53e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Volume 16dba9bc-83bb-4a76-9dc1-64ff5cf68761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761', 'volume_size': 1} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-d6994ced-9892-423f-899a-e5d92b026772 (d6994ced-9892-423f-899a-e5d92b026772): created successfully Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d3e47f-cb78-4bb0-9a88-47653fc62cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (7e794e13-6e03-423c-8053-8252ac3510b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-452386e2-3a0a-48f0-9b45-9855b581f105 tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (6f5e1158-468a-4dc2-b6d1-b3ae0ae9fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc8682-c49e-4548-a8dc-cfddd762d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc8682-c49e-4548-a8dc-cfddd762d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296719953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a2c08e-6b91-4339-84b1-074f300fcc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f31f7-2698-4d1a-b95a-5fecd94b74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34f31f7-2698-4d1a-b95a-5fecd94b74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ff883e-1874-4974-82a8-74902f7df85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ff883e-1874-4974-82a8-74902f7df85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a2c08e-6b91-4339-84b1-074f300fcc02', 'volume_name': 'volume-80a2c08e-6b91-4339-84b1-074f300fcc02', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd5c053-45b8-4fb7-91da-f50561b0e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd5c053-45b8-4fb7-91da-f50561b0e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1651717d-5284-4ea7-b2a1-f0d986d70c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume 80a2c08e-6b91-4339-84b1-074f300fcc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a2c08e-6b91-4339-84b1-074f300fcc02', 'volume_size': 1} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:47 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc" returned: 0 in 0.677s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:47 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc Nov 02 09:57:47 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (5d021590-2a7e-4547-8e89-5794fb26e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d60b5de-1bd1-44bc-b46e-346648e6a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d60b5de-1bd1-44bc-b46e-346648e6a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585189776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62bdf60-9f29-43ff-bda5-a051050cc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716071b1-ea05-4dba-b4f3-8f6d9a38aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716071b1-ea05-4dba-b4f3-8f6d9a38aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024af85a-8f7f-40a8-9ef0-01b64906e5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024af85a-8f7f-40a8-9ef0-01b64906e5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62bdf60-9f29-43ff-bda5-a051050cc54d', 'volume_name': 'volume-b62bdf60-9f29-43ff-bda5-a051050cc54d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d6c7d-fb12-4ec5-9e03-627060f70c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d6c7d-fb12-4ec5-9e03-627060f70c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0426a4d-b87a-4d20-821d-779ddd508fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume b62bdf60-9f29-43ff-bda5-a051050cc54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62bdf60-9f29-43ff-bda5-a051050cc54d', 'volume_size': 1} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:48 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:48 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-23839b9d-b52c-4517-b193-82487d30e5bc" returned: 0 in 0.384s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 1073741824" returned: 0 in 0.934s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-quobyte-23839b9d-b52c-4517-b193-82487d30e5bc" released by "delete_volume" :: held 1.182s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:48 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 Nov 02 09:57:48 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Created reservations ['7de50372-0a25-4c3a-9a86-f08aab9a70fa', '6f25c22e-bd8a-4085-80a5-7e5991f091d7', 'a77b07c7-8485-4b51-8170-3d15d4c40fb8', 'b2c69d54-830d-40ba-900f-ee96f66e2b22'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:48 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:48 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Flow 'volume_create_manager' (769646a7-5d7b-40c2-bef3-e7db13c279f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a098597-1a30-42cd-803a-597230023199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a098597-1a30-42cd-803a-597230023199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee54627-cfc5-452a-a951-6f36e39ef38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e91a5465aab43fc9de61f5408b6891c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='ae4d59457c50436d807bec4c91334d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b358b194-411c-4ac0-8beb-64d9f09fb8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b358b194-411c-4ac0-8beb-64d9f09fb8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f37a4-3383-4ded-9957-692bc07c4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.image.glance [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Creating Keystone auth plugin from conf {{(pid=86887) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 09:57:48 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511530821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d86fbaf-a399-4600-bf1b-c9a971d43227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:47Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume 8d86fbaf-a399-4600-bf1b-c9a971d43227 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:48 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 1073741824 Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998f9c1c-b001-4f06-bb25-4045921f8e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcfaa97-ab78-4e94-a82d-7327b573240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 (a0ecc70e-0fc3-4cb7-8500-566fd2a803b1): created successfully Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcfaa97-ab78-4e94-a82d-7327b573240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (9c31b3cd-2a3d-4303-9964-e7a9f1557eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f2cd7207-1d0a-4150-bb96-890a8e28ed6c tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:48 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Deleted volume successfully. Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd358c48-f06b-4cdb-9da2-a2724aca2c75 tempest-VolumeDependencyTests-1893477816 None] Lock "cinder-23839b9d-b52c-4517-b193-82487d30e5bc-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730f37a4-3383-4ded-9957-692bc07c4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bee54627-cfc5-452a-a951-6f36e39ef38a', 'volume_name': 'volume-bee54627-cfc5-452a-a951-6f36e39ef38a', 'volume_size': 1, 'image_id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ca43ff3b1ee615e70ee157edfaa8968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e91a5465aab43fc9de61f5408b6891c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aac88cb8ed4b0564ae2d8413ff0708b6bc66d7f7e08d4c5387709b85065cf11dfe8bd82bf2301f2edeb00a25c435457569ce70be1f3375f4c97a15d6f26353d8', 'id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee10dc8c-7a51-415f-839c-ee189f456ad2/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f34b5a-c217-493a-9476-8233a5405e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f34b5a-c217-493a-9476-8233a5405e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123b4637-b776-4378-967c-bdf1793d3677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Volume bee54627-cfc5-452a-a951-6f36e39ef38a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bee54627-cfc5-452a-a951-6f36e39ef38a', 'volume_size': 1, 'image_id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ca43ff3b1ee615e70ee157edfaa8968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e91a5465aab43fc9de61f5408b6891c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aac88cb8ed4b0564ae2d8413ff0708b6bc66d7f7e08d4c5387709b85065cf11dfe8bd82bf2301f2edeb00a25c435457569ce70be1f3375f4c97a15d6f26353d8', 'id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee10dc8c-7a51-415f-839c-ee189f456ad2/file', 'properties': {}}, 'image_service': } Nov 02 09:57:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Trying to clone bee54627-cfc5-452a-a951-6f36e39ef38a from image ee10dc8c-7a51-415f-839c-ee189f456ad2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}]). {{(pid=86887) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 09:57:49 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Image download 0.00 MB at 0.00 MB/s Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9568111e-ce4c-4fae-857e-1439709f4cf5]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:49 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 1073741824" returned: 0 in 0.564s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:49 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:49 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:49 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 Nov 02 09:57:49 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:49 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:49 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227" returned: 0 in 0.277s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.068s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dba9bc-83bb-4a76-9dc1-64ff5cf68761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe9f771d6c49eeba75acdf71813880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:47Z,use_quota=True,user_id='67579ba819a546a78ebbcb5b0f0c1ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Creating volume 16dba9bc-83bb-4a76-9dc1-64ff5cf68761 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:49 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:49 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 1073741824 Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7bea9c-cb9c-4b40-805a-9e7c8e188d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d86fbaf-a399-4600-bf1b-c9a971d43227', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:49 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ad2849-8c49-4360-a788-85c46c620b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:49 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 (8d86fbaf-a399-4600-bf1b-c9a971d43227): created successfully Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ad2849-8c49-4360-a788-85c46c620b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (5b4f04cd-8d10-4032-825c-20f7852d92f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-51c40890-6ea8-4260-8900-edfff8bf4b2f tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:49 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:49 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:49 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 1 in 0.395s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Temporary image ee10dc8c-7a51-415f-839c-ee189f456ad2 is fetched for user ae4d59457c50436d807bec4c91334d02. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2bbc21-7681-43fd-a592-c9adaf46bd8f]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:50 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 1073741824" returned: 0 in 0.555s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:50 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:50 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:50 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 Nov 02 09:57:50 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:50 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:50 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296719953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a2c08e-6b91-4339-84b1-074f300fcc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume 80a2c08e-6b91-4339-84b1-074f300fcc02 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:50 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:50 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:50 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:50 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 1073741824 Nov 02 09:57:50 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3d96f6-fcc6-42d1-8efe-4eadba53e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922291db-bf05-43d5-aaed-600fe98f3372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:50 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Volume volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 (16dba9bc-83bb-4a76-9dc1-64ff5cf68761): created successfully Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922291db-bf05-43d5-aaed-600fe98f3372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Flow 'volume_create_manager' (805972d5-8b19-428c-9cfa-5251efd2f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c0b47767-41e6-472f-9f17-630fd87d55b4 tempest-CinderUnicodeTest-2008764942 None] Created volume successfully. Nov 02 09:57:50 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:51 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 1073741824" returned: 0 in 0.502s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:51 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 Nov 02 09:57:51 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:51 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02" returned: 0 in 0.340s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.289s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585189776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62bdf60-9f29-43ff-bda5-a051050cc54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2642e940079485a911a55a5de318228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='7117628419cb4d02bb1d0a67c043ec29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Creating volume b62bdf60-9f29-43ff-bda5-a051050cc54d {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:51 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1651717d-5284-4ea7-b2a1-f0d986d70c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a2c08e-6b91-4339-84b1-074f300fcc02', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008bfe57-2e3e-4765-ba3d-621e04e5a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:51 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d 1073741824 Nov 02 09:57:51 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-80a2c08e-6b91-4339-84b1-074f300fcc02 (80a2c08e-6b91-4339-84b1-074f300fcc02): created successfully Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (008bfe57-2e3e-4765-ba3d-621e04e5a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (6f5e1158-468a-4dc2-b6d1-b3ae0ae9fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:51 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-df642270-638d-4f39-9075-e4d34912d04d tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:57:52 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Flow 'volume_create_manager' (9346aa24-cbb3-413f-b0e6-6919e2019b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfe7c7c-6e8b-4208-b472-62327139cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d 1073741824" returned: 0 in 0.662s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfe7c7c-6e8b-4208-b472-62327139cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1994851096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b672491-d089-4e6c-809a-753c6d428431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe9f771d6c49eeba75acdf71813880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:52Z,use_quota=True,user_id='67579ba819a546a78ebbcb5b0f0c1ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22c3687-2256-4633-8f6a-e8533e18aa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22c3687-2256-4633-8f6a-e8533e18aa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbbcaac-b5bc-464f-8c6a-f68a0e4e10c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbbcaac-b5bc-464f-8c6a-f68a0e4e10c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b672491-d089-4e6c-809a-753c6d428431', 'volume_name': 'volume-4b672491-d089-4e6c-809a-753c6d428431', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95a717e-1619-4cd7-a4bf-fa9a0a6d0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95a717e-1619-4cd7-a4bf-fa9a0a6d0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31afbf7-092f-40c9-ad5e-e1a5432726ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Volume 4b672491-d089-4e6c-809a-753c6d428431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b672491-d089-4e6c-809a-753c6d428431', 'volume_size': 1} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:52 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d Nov 02 09:57:52 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:52 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee54627-cfc5-452a-a951-6f36e39ef38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e91a5465aab43fc9de61f5408b6891c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:48Z,use_quota=True,user_id='ae4d59457c50436d807bec4c91334d02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Creating volume bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:52 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0426a4d-b87a-4d20-821d-779ddd508fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62bdf60-9f29-43ff-bda5-a051050cc54d', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0374c-3710-457e-b06a-0b0f83cb7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:52 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1073741824 Nov 02 09:57:52 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:52 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Volume volume-b62bdf60-9f29-43ff-bda5-a051050cc54d (b62bdf60-9f29-43ff-bda5-a051050cc54d): created successfully Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d0374c-3710-457e-b06a-0b0f83cb7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Flow 'volume_create_manager' (5d021590-2a7e-4547-8e89-5794fb26e183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ce4ac112-4e56-4231-b3a5-b7bb39e2b682 tempest-CreateVolumesFromSnapshotTest-476441955 None] Created volume successfully. Nov 02 09:57:53 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1073741824" returned: 0 in 0.554s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:53 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a Nov 02 09:57:53 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:53 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:57:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1994851096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b672491-d089-4e6c-809a-753c6d428431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fabe9f771d6c49eeba75acdf71813880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:57:52Z,use_quota=True,user_id='67579ba819a546a78ebbcb5b0f0c1ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Creating volume 4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:57:53 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Attempting download of ee10dc8c-7a51-415f-839c-ee189f456ad2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}])) to volume bee54627-cfc5-452a-a951-6f36e39ef38a. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 09:57:53 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 1073741824 Nov 02 09:57:53 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[24537b0b-7341-49f8-9ca7-85f023f40e78]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:53 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0 Nov 02 09:57:53 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-b62bdf60-9f29-43ff-bda5-a051050cc54d-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-b62bdf60-9f29-43ff-bda5-a051050cc54d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-b62bdf60-9f29-43ff-bda5-a051050cc54d" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-b62bdf60-9f29-43ff-bda5-a051050cc54d" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3377d77-cee0-4768-bd48-5e5f9562cff2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d Nov 02 09:57:54 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0" returned: 0 in 0.579s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 1073741824" returned: 0 in 0.684s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 Nov 02 09:57:54 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0 Nov 02 09:57:54 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d" returned: 0 in 0.452s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d Nov 02 09:57:54 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431" returned: 0 in 0.316s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31afbf7-092f-40c9-ad5e-e1a5432726ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b672491-d089-4e6c-809a-753c6d428431', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:54 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e974b7be-fe08-442c-bead-e7f6386e5284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0" returned: 1 in 0.414s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee10dc8c-7a51-415f-839c-ee189f456ad2_3gfz7gk0' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eccd18-1ae5-4e54-914e-e4cda03f2dc1]: (4, 'raw') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Volume volume-4b672491-d089-4e6c-809a-753c6d428431 (4b672491-d089-4e6c-809a-753c6d428431): created successfully Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e974b7be-fe08-442c-bead-e7f6386e5284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Flow 'volume_create_manager' (9346aa24-cbb3-413f-b0e6-6919e2019b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:54 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4626147b-79be-44ea-9a7d-47d74e7618bd tempest-CinderUnicodeTest-2008764942 None] Created volume successfully. Nov 02 09:57:54 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b62bdf60-9f29-43ff-bda5-a051050cc54d" returned: 0 in 0.305s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:54 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-b62bdf60-9f29-43ff-bda5-a051050cc54d" released by "delete_volume" :: held 0.807s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['6eeb9468-24c4-46ea-94d8-0c3dd664a210', 'b3cb0bd3-e693-4b8f-bf0f-064cb042d761', 'a7285a4a-d010-4cd7-a8fd-638686fcdd01', '6a10c835-15f8-41ab-8c7a-8b24cc5340f0'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:54 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:54 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:54 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-80a2c08e-6b91-4339-84b1-074f300fcc02-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-80a2c08e-6b91-4339-84b1-074f300fcc02-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:55 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD Nov 02 09:57:55 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-80a2c08e-6b91-4339-84b1-074f300fcc02" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-80a2c08e-6b91-4339-84b1-074f300fcc02" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f700e909-e75b-4e6e-b8e2-b6c57eb2e82e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:55 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.407s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-116b42fe-cced-4a44-a6b5-df9f58a6bbab tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-b62bdf60-9f29-43ff-bda5-a051050cc54d-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:55 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 Nov 02 09:57:55 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:55 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD" returned: 1 in 0.517s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] ee10dc8c-7a51-415f-839c-ee189f456ad2 was raw, converting to qcow2 {{(pid=86887) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:55 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a Nov 02 09:57:55 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Creating offline snapshot f115ff82-ecf7-483e-9010-6e1e38de1818 of volume 4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a49f89-8dc7-42ff-8481-0290473eee8c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:55 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02" returned: 0 in 0.563s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:55 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 Nov 02 09:57:55 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:55 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02 Nov 02 09:57:55 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:56 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-80a2c08e-6b91-4339-84b1-074f300fcc02" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-80a2c08e-6b91-4339-84b1-074f300fcc02" released by "delete_volume" :: held 0.976s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:56 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431" returned: 0 in 0.510s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:56 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a" returned: 0 in 0.737s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee10dc8c-7a51-415f-839c-ee189f456ad2_n2t4lyfddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:57:56 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:56 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 1G Nov 02 09:57:56 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:56 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1G Nov 02 09:57:56 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['52c9c0b3-8383-481e-a701-0b2b24a315c1', '3cf182d1-6500-4dbe-b38f-1d4b2f45df66', '39444049-5cc3-4e59-baf6-fef0a470cdac', 'fd523307-addc-4f32-b72a-2a4fd6043786'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:56 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:56 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:56 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a 1G" returned: 0 in 0.485s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Downloaded image ee10dc8c-7a51-415f-839c-ee189f456ad2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}])) to volume bee54627-cfc5-452a-a951-6f36e39ef38a successfully. {{(pid=86887) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Temporary image ee10dc8c-7a51-415f-839c-ee189f456ad2 for user ae4d59457c50436d807bec4c91334d02 is deleted. {{(pid=86887) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.volume_utils [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Marking volume bee54627-cfc5-452a-a951-6f36e39ef38a as bootable. {{(pid=86887) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Copying metadata from image ee10dc8c-7a51-415f-839c-ee189f456ad2 to bee54627-cfc5-452a-a951-6f36e39ef38a. {{(pid=86887) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Creating volume glance metadata for volume bee54627-cfc5-452a-a951-6f36e39ef38a backed by image ee10dc8c-7a51-415f-839c-ee189f456ad2 with: {'image_id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5ca43ff3b1ee615e70ee157edfaa8968', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86887) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 09:57:56 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 1G" returned: 0 in 0.609s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b672491-d089-4e6c-809a-753c6d428431 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:56 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.340s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:57:56 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b672491-d089-4e6c-809a-753c6d428431 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 Nov 02 09:57:56 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123b4637-b776-4378-967c-bdf1793d3677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee54627-cfc5-452a-a951-6f36e39ef38a', 'volume_size': 1, 'image_id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee10dc8c-7a51-415f-839c-ee189f456ad2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ca43ff3b1ee615e70ee157edfaa8968', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e91a5465aab43fc9de61f5408b6891c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aac88cb8ed4b0564ae2d8413ff0708b6bc66d7f7e08d4c5387709b85065cf11dfe8bd82bf2301f2edeb00a25c435457569ce70be1f3375f4c97a15d6f26353d8', 'id': 'ee10dc8c-7a51-415f-839c-ee189f456ad2', 'created_at': datetime.datetime(2026, 11, 2, 8, 57, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 8, 57, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee10dc8c-7a51-415f-839c-ee189f456ad2/file', 'properties': {}}, 'image_service': }' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09e965-842b-43f9-a75e-bd69ff46f1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b7e15169-cf41-4c86-9e0c-ce65c045322e tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-80a2c08e-6b91-4339-84b1-074f300fcc02-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Volume volume-bee54627-cfc5-452a-a951-6f36e39ef38a (bee54627-cfc5-452a-a951-6f36e39ef38a): created successfully Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe09e965-842b-43f9-a75e-bd69ff46f1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:57:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Flow 'volume_create_manager' (769646a7-5d7b-40c2-bef3-e7db13c279f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:57:56 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5d4390df-6973-4f48-9394-464f9d158ff2 tempest-VolumeImageDependencyTests-933335489 None] Created volume successfully. Nov 02 09:57:57 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b672491-d089-4e6c-809a-753c6d428431 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:57 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 is being set with open permissions: ugo+rw Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:57 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 Nov 02 09:57:57 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Acquiring lock "cinder-bee54627-cfc5-452a-a951-6f36e39ef38a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "cinder-bee54627-cfc5-452a-a951-6f36e39ef38a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Acquiring lock "cinder-quobyte-bee54627-cfc5-452a-a951-6f36e39ef38a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "cinder-quobyte-bee54627-cfc5-452a-a951-6f36e39ef38a" acquired by "delete_volume" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[11485c10-df38-4d44-8788-8eb61d445529]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-8d86fbaf-a399-4600-bf1b-c9a971d43227-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-8d86fbaf-a399-4600-bf1b-c9a971d43227-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-8d86fbaf-a399-4600-bf1b-c9a971d43227" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-8d86fbaf-a399-4600-bf1b-c9a971d43227" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:57 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:57 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a Nov 02 09:57:57 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818" returned: 0 in 0.380s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf827af9-935b-40ca-842c-52d44174d33c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:57 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info Nov 02 09:57:57 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:57 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 Nov 02 09:57:57 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:57 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a" returned: 0 in 0.490s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:57 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a Nov 02 09:57:57 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info" returned: 0 in 0.318s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info is being set with open permissions: ugo+rw Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:58 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info Nov 02 09:57:58 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:58 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227 Nov 02 09:57:58 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:58 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bee54627-cfc5-452a-a951-6f36e39ef38a" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:58 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "cinder-quobyte-bee54627-cfc5-452a-a951-6f36e39ef38a" released by "delete_volume" :: held 0.869s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Created reservations ['b26db21b-dbb2-468c-b18d-8529e31d39ff', 'f5d64280-c39a-44c2-a6f3-0bb0ab0c70f7', '63822963-1904-46ce-a180-a1fce7e7ae09', 'ab7f9189-f03e-43a3-9f81-82252573b59b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:58 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.info" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2ba2b5c6-8fcf-4af8-b93e-13d0ed616961 tempest-CinderUnicodeTest-2008764942 None] Create snapshot completed successfully Nov 02 09:57:58 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8d86fbaf-a399-4600-bf1b-c9a971d43227" returned: 0 in 0.374s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-8d86fbaf-a399-4600-bf1b-c9a971d43227" released by "delete_volume" :: held 0.946s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:58 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:58 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.379s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['b0105b5f-20a7-4922-8449-9dc189a147fa', 'a028b30a-10d9-45e7-9639-ccab12c64c04', '6b0d6319-dd8b-4555-b95e-921bb0c565db', '1bd40acc-2c4f-49b2-ada7-b6c71406315c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:58 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:57:58 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:58 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:58 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Deleted volume successfully. Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-f115ff82-ecf7-483e-9010-6e1e38de1818-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0474d4d0-64b2-459f-8df9-dc6a7ccaf08e tempest-VolumeImageDependencyTests-933335489 None] Lock "cinder-bee54627-cfc5-452a-a951-6f36e39ef38a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-f115ff82-ecf7-483e-9010-6e1e38de1818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-quobyte-f115ff82-ecf7-483e-9010-6e1e38de1818" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-f115ff82-ecf7-483e-9010-6e1e38de1818" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Deleting offline snapshot f115ff82-ecf7-483e-9010-6e1e38de1818 of volume 4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] snapshot_file for this snap is: volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[796a5836-1a8a-40a0-ae83-66de7dadd11e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:59 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:57:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:57:59 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 Nov 02 09:57:59 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-b8018b17-0801-4813-be95-2163a548b823 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-8d86fbaf-a399-4600-bf1b-c9a971d43227-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:57:59 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818" returned: 0 in 0.450s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b672491-d089-4e6c-809a-753c6d428431(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350fa7a-8b96-4ead-a955-e60216fab6ff]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:57:59 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 Nov 02 09:57:59 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:57:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:00 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431" returned: 0 in 0.524s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9d2e4-4082-4168-950f-14976acbe15c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:00 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 Nov 02 09:58:00 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:00 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 Nov 02 09:58:00 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:00 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (249c0877-9e23-480a-8762-80c0163bf459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:00 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a986864-21c4-4afb-937f-05567c7a2219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818" returned: 0 in 0.531s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" returned: 0 in 0.512s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:00 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818 Nov 02 09:58:00 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a986864-21c4-4afb-937f-05567c7a2219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139284633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87438bce-f313-4650-b7f8-b444622be324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:00Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f518c4a-a955-4865-a084-424acb969310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:00 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1 Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f518c4a-a955-4865-a084-424acb969310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:00 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed02a87-acd7-4fcc-ba1b-fc7b559f6f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed02a87-acd7-4fcc-ba1b-fc7b559f6f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87438bce-f313-4650-b7f8-b444622be324', 'volume_name': 'volume-87438bce-f313-4650-b7f8-b444622be324', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff527e7-8df8-43f6-a372-0af4a5ea8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff527e7-8df8-43f6-a372-0af4a5ea8a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58034bdd-b793-41bb-8671-fd19b9a8154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:00 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Volume 87438bce-f313-4650-b7f8-b444622be324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87438bce-f313-4650-b7f8-b444622be324', 'volume_size': 1} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139284633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87438bce-f313-4650-b7f8-b444622be324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:00Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Creating volume 87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:00 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:00 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 1073741824 Nov 02 09:58:00 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:00 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431.f115ff82-ecf7-483e-9010-6e1e38de1818" returned: 0 in 0.298s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:00 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" returned: 0 in 0.340s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-f115ff82-ecf7-483e-9010-6e1e38de1818" released by "_delete_snapshot" :: held 1.973s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" released by "delete_snapshot" :: held 2.014s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1" released by "delete_volume" :: held 0.982s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['344b36a5-d691-4ab7-8a39-4607a48e6a73', 'f34772a6-8ef0-4054-bff6-cf4053e6fd04', '03406010-c987-436d-8a0b-921cf01c7f98', 'e4dc5bf0-56a1-4f35-8974-9b15babe6a84'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Created reservations ['2ec06060-7f26-4330-a982-be7948d0a493', 'a6056a82-33f8-4def-b487-cecdf5d9f95a', 'f3e59d4a-f8de-4f7a-a16d-429f79a0fd88', 'fd5dae73-3b96-4b50-a840-df4c0e86779f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Delete snapshot completed successfully. Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-09c75abe-792c-49fc-b2b7-54413914311f tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-f115ff82-ecf7-483e-9010-6e1e38de1818-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:01 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:01 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:01 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 1073741824" returned: 0 in 0.673s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:01 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 Nov 02 09:58:01 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:01 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a850bfc-1b09-4829-a002-68084a62bbdc tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-a0ecc70e-0fc3-4cb7-8500-566fd2a803b1-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:01 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58034bdd-b793-41bb-8671-fd19b9a8154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87438bce-f313-4650-b7f8-b444622be324', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c2fe75-405f-453f-80e1-d35fa04fce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Volume volume-87438bce-f313-4650-b7f8-b444622be324 (87438bce-f313-4650-b7f8-b444622be324): created successfully Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c2fe75-405f-453f-80e1-d35fa04fce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (249c0877-9e23-480a-8762-80c0163bf459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:01 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-198b262a-4135-43b1-ac97-033911d1be36 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-4b672491-d089-4e6c-809a-753c6d428431-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-d6994ced-9892-423f-899a-e5d92b026772-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-4b672491-d089-4e6c-809a-753c6d428431-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-d6994ced-9892-423f-899a-e5d92b026772-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-d6994ced-9892-423f-899a-e5d92b026772" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-d6994ced-9892-423f-899a-e5d92b026772" acquired by "delete_volume" :: waited 0.056s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[df771a51-3a1c-4801-ab86-01ce0c3ea247]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cbdebf-c396-4b0f-9fb9-bb2d69c6b331]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:02 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 Nov 02 09:58:02 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 Nov 02 09:58:02 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:02 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:02 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772" returned: 0 in 0.450s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:02 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431" returned: 0 in 0.482s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:02 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772 Nov 02 09:58:02 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:02 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431 Nov 02 09:58:02 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 6aa20e67-1ba7-4468-a878-105611ea23d9 of volume 87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb957c9-554d-4653-9231-3d03e9c03b2d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:03 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:03 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-4b672491-d089-4e6c-809a-753c6d428431" returned: 0 in 0.342s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-d6994ced-9892-423f-899a-e5d92b026772" returned: 0 in 0.379s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-4b672491-d089-4e6c-809a-753c6d428431" released by "delete_volume" :: held 0.912s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-d6994ced-9892-423f-899a-e5d92b026772" released by "delete_volume" :: held 0.888s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:03 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 Nov 02 09:58:03 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['4698c45c-a60e-4016-b8f8-cd29be9aefd9', 'f78aaba4-4831-40c4-bed8-7dee57d96e6f', '49f347de-caef-4fd7-bfb5-7432011420ab', 'f3828190-689d-4707-a599-8c806521954b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Created reservations ['f10af925-4fbb-4146-a9d4-e5cd27a7f9fe', 'b55c471e-e660-4ba7-b63d-5cbb301d1c94', '29d89e05-405e-4a18-a39b-598da2689b5b', '7eb19184-cca7-4ba2-bed5-81b47b5bf121'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:03 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:03 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:03 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:03 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:03 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324" returned: 0 in 0.477s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:03 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 1G Nov 02 09:58:03 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:03 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.329s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Deleted volume successfully. Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d1a554b7-e4cd-42bd-b4a2-27e35f9789a8 tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-4b672491-d089-4e6c-809a-753c6d428431-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:03 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:58:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-4f112ed4-af2d-4416-ad8f-e40412765f49 tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-d6994ced-9892-423f-899a-e5d92b026772-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:04 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 1G" returned: 0 in 0.558s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87438bce-f313-4650-b7f8-b444622be324 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:04 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87438bce-f313-4650-b7f8-b444622be324 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 Nov 02 09:58:04 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-16dba9bc-83bb-4a76-9dc1-64ff5cf68761-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-16dba9bc-83bb-4a76-9dc1-64ff5cf68761-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "cinder-quobyte-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:04 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-acc8a86a-c8b3-4a91-83d4-b47c34e61532-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87438bce-f313-4650-b7f8-b444622be324 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9" returned: 0 in 0.445s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:04 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 is being set with open permissions: ugo+rw Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0dc213-3790-4dee-a662-5f68f332b40d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-acc8a86a-c8b3-4a91-83d4-b47c34e61532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:04 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 Nov 02 09:58:04 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-acc8a86a-c8b3-4a91-83d4-b47c34e61532" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-acc8a86a-c8b3-4a91-83d4-b47c34e61532" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleting offline snapshot acc8a86a-c8b3-4a91-83d4-b47c34e61532 of volume 94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] snapshot_file for this snap is: volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb43e23-0922-45e1-b159-58ac575d3f8d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:04 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 Nov 02 09:58:04 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 Nov 02 09:58:05 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:05 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info Nov 02 09:58:05 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" returned: 0 in 0.571s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:05 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761 Nov 02 09:58:05 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532" returned: 0 in 0.528s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94b17060-f077-4280-8585-bf7daef60b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fb64d0-d529-477a-accb-b963cf26bda2]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:05 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info is being set with open permissions: ugo+rw Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:05 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info Nov 02 09:58:05 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 Nov 02 09:58:05 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-quobyte-16dba9bc-83bb-4a76-9dc1-64ff5cf68761" released by "delete_volume" :: held 0.987s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Created reservations ['3ca4c1a6-96a5-4b83-8541-e22ef66d6e83', '8a1d3117-b919-41ee-8962-714b0f843228', '03faa6a5-0d08-4142-a812-709e347612e6', 'abde4466-a2bf-44d0-aefd-3ecf72386455'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:05 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.info" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:05 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:05 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-47180f08-5977-40de-b809-109fdc09ce7d tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:58:06 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93" returned: 0 in 0.622s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:06 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 Nov 02 09:58:06 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:06 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Deleted volume successfully. Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7322f364-492f-4399-a9c8-82fb78ecabec tempest-CinderUnicodeTest-2008764942 None] Lock "cinder-16dba9bc-83bb-4a76-9dc1-64ff5cf68761-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-6aa20e67-1ba7-4468-a878-105611ea23d9-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-6aa20e67-1ba7-4468-a878-105611ea23d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-6aa20e67-1ba7-4468-a878-105611ea23d9" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-6aa20e67-1ba7-4468-a878-105611ea23d9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 6aa20e67-1ba7-4468-a878-105611ea23d9 of volume 87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56c585-9167-4828-b824-77b1ef51d8a0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:06 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:06 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532 Nov 02 09:58:06 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:06 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 Nov 02 09:58:06 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:06 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93.acc8a86a-c8b3-4a91-83d4-b47c34e61532" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-acc8a86a-c8b3-4a91-83d4-b47c34e61532" released by "_delete_snapshot" :: held 2.039s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" released by "delete_snapshot" :: held 2.069s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['75b949a6-9340-43d2-9cf4-87079c6799a0', '7fe39df9-1a54-4cee-99bb-f1a7f867f1a8', '20b2a1d2-1cea-4085-bea3-2b67562ae29e', 'acace23a-2f20-471b-a506-53635e1a1fb9'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:07 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9" returned: 0 in 0.529s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87438bce-f313-4650-b7f8-b444622be324(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f84ecf-763d-4f9c-821a-661e8306062a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:07 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Delete snapshot completed successfully. Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-8a9140f9-9787-4f04-8d7a-970664e0238b tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-acc8a86a-c8b3-4a91-83d4-b47c34e61532-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:07 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 Nov 02 09:58:07 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:07 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324" returned: 0 in 0.487s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:07 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 Nov 02 09:58:07 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:08 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:08 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9 Nov 02 09:58:08 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-94b17060-f077-4280-8585-bf7daef60b93-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-94b17060-f077-4280-8585-bf7daef60b93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecbe65c-3c8e-4b79-8135-2e86bad9481e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:08 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324.6aa20e67-1ba7-4468-a878-105611ea23d9" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-6aa20e67-1ba7-4468-a878-105611ea23d9" released by "_delete_snapshot" :: held 2.114s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" released by "delete_snapshot" :: held 2.145s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:08 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 Nov 02 09:58:08 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Created reservations ['286496f3-159c-4880-8ff6-8cf235325e2e', '36df7cab-bac5-45fa-b112-5c06338947c7', '2b28b851-400c-45e6-88f6-bf37fbcfb3b0', 'dc8e0fae-3ca6-48e4-9cab-86fb455fdddd'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-2361b79f-16ae-4cec-93a4-6306ade51945 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-6aa20e67-1ba7-4468-a878-105611ea23d9-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:08 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93" returned: 0 in 0.574s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:09 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93 Nov 02 09:58:09 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:09 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94b17060-f077-4280-8585-bf7daef60b93" returned: 0 in 0.308s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-quobyte-94b17060-f077-4280-8585-bf7daef60b93" released by "delete_volume" :: held 1.027s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Created reservations ['017de88a-dc2a-4009-a8fe-02bdb4bb8c43', '7a5e5d75-dc73-45d9-800b-c68bebde4d1f', '3ce97647-14d6-43bd-9731-a5e1f2c62474', '692f9aca-e0c7-4f1d-82d0-4f91a6bc5e44'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=227,cinder:UPDATE=287,cinder:INSERT=69,cinder:DELETE=27 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:09 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:09 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-87438bce-f313-4650-b7f8-b444622be324-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-87438bce-f313-4650-b7f8-b444622be324-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" acquired by "delete_volume" :: waited 0.032s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:09 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Deleted volume successfully. Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=199,cinder:UPDATE=287,cinder:INSERT=86,cinder:DELETE=24 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333de12-0393-4cb6-8e2d-0da580653d48]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0a848853-9dba-43f9-b74b-94234bee83bb tempest-CreateVolumesFromSnapshotTest-476441955 None] Lock "cinder-94b17060-f077-4280-8585-bf7daef60b93-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:09 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 Nov 02 09:58:09 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:10 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324" returned: 0 in 0.430s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:10 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324 Nov 02 09:58:10 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:10 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-87438bce-f313-4650-b7f8-b444622be324" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-87438bce-f313-4650-b7f8-b444622be324" released by "delete_volume" :: held 0.862s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Created reservations ['49045cea-7bd3-4000-92b0-c13f551d70b4', '2495133f-ddb7-4a79-be15-c769d7eed7e7', 'a5ce3c78-847d-4497-b1ad-5757325e9864', 'c7a53e59-6459-4a6c-8495-a782971dea00'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:10 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:10 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:11 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.336s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-cd6d973b-0d2f-46fd-8a1d-0e28d598c2e5 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-87438bce-f313-4650-b7f8-b444622be324-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (fc5d7cd4-b0f4-4c63-845d-c22b625328e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d33c80-e803-4b58-9cbe-4d3bf6674088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d33c80-e803-4b58-9cbe-4d3bf6674088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021917320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06c910c-c410-424c-861c-e35533c3b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:12Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34dd568-51f1-4dad-85aa-7a14cfca001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34dd568-51f1-4dad-85aa-7a14cfca001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a16582-5d0c-466b-ae5e-519bca042526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a16582-5d0c-466b-ae5e-519bca042526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06c910c-c410-424c-861c-e35533c3b12c', 'volume_name': 'volume-b06c910c-c410-424c-861c-e35533c3b12c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b045e923-db0f-4fe3-94c0-136a044bfcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b045e923-db0f-4fe3-94c0-136a044bfcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9133668f-ae7e-4ddc-9543-ac821c0d93dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Volume b06c910c-c410-424c-861c-e35533c3b12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06c910c-c410-424c-861c-e35533c3b12c', 'volume_size': 1} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021917320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06c910c-c410-424c-861c-e35533c3b12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:12Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Creating volume b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:11 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:11 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c 1073741824 Nov 02 09:58:11 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:12 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c 1073741824" returned: 0 in 0.605s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:12 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c Nov 02 09:58:12 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:12 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c" returned: 0 in 0.342s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9133668f-ae7e-4ddc-9543-ac821c0d93dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06c910c-c410-424c-861c-e35533c3b12c', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:12 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d80f99-e73c-44dd-bdaf-13aa02b1b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Volume volume-b06c910c-c410-424c-861c-e35533c3b12c (b06c910c-c410-424c-861c-e35533c3b12c): created successfully Nov 02 09:58:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d80f99-e73c-44dd-bdaf-13aa02b1b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (fc5d7cd4-b0f4-4c63-845d-c22b625328e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-930d5c31-524b-4135-b181-779774614867 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 693e337c-17a7-453f-9e59-61272cd80c2f of volume b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a0b71e-e272-4846-9234-1e6ec3c3ad40]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:14 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c Nov 02 09:58:14 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:14 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c" returned: 0 in 0.516s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:14 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f 1G Nov 02 09:58:14 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:15 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f 1G" returned: 0 in 0.599s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06c910c-c410-424c-861c-e35533c3b12c -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:15 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06c910c-c410-424c-861c-e35533c3b12c -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f Nov 02 09:58:15 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:15 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-f80486a7-1453-4d0e-9add-efba2753b605 tempest-ProjectAdminTests-1051659110 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.889347076416, 'free_capacity_gb': 1773.889347076416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86887) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 09:58:15 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06c910c-c410-424c-861c-e35533c3b12c -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f" returned: 0 in 0.538s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:15 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f is being set with open permissions: ugo+rw Nov 02 09:58:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:15 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f Nov 02 09:58:15 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:16 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f" returned: 0 in 0.344s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:16 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info Nov 02 09:58:16 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:16 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info" returned: 0 in 0.283s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:16 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info is being set with open permissions: ugo+rw Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:16 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info Nov 02 09:58:16 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:16 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.info" returned: 0 in 0.360s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:16 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e78ecbbc-e546-490c-9951-81717004106f tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-693e337c-17a7-453f-9e59-61272cd80c2f-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-693e337c-17a7-453f-9e59-61272cd80c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-693e337c-17a7-453f-9e59-61272cd80c2f" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-693e337c-17a7-453f-9e59-61272cd80c2f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 693e337c-17a7-453f-9e59-61272cd80c2f of volume b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0469859-c4b8-4ba0-b397-f79e3140b964]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:17 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f Nov 02 09:58:17 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:18 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06c910c-c410-424c-861c-e35533c3b12c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e41d3-6237-4633-8e76-c678c7622e6b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:18 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c Nov 02 09:58:18 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:18 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c" returned: 0 in 0.565s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:18 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f Nov 02 09:58:18 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:19 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:19 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f Nov 02 09:58:19 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:19 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c.693e337c-17a7-453f-9e59-61272cd80c2f" returned: 0 in 0.396s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-693e337c-17a7-453f-9e59-61272cd80c2f" released by "_delete_snapshot" :: held 2.115s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" released by "delete_snapshot" :: held 2.144s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:19 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Created reservations ['83a850c9-8634-49a3-b8bd-b9256f9ba278', '180e4f0d-ed20-4e3c-8d63-3e566b92698c', '101e92f5-e4e1-4a6d-bd78-80e198761a75', 'ccc8f25a-59cf-4a86-9a60-3ed86bf29a9c'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:20 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:58:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-769f09b0-fb19-430a-b875-525f572b1bc2 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-693e337c-17a7-453f-9e59-61272cd80c2f-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-b06c910c-c410-424c-861c-e35533c3b12c-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:20 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-b06c910c-c410-424c-861c-e35533c3b12c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11aa7e6-2740-478a-acfc-a6f9d8b97208]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:21 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c Nov 02 09:58:21 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:21 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c" returned: 0 in 0.589s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:21 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c Nov 02 09:58:21 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:22 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b06c910c-c410-424c-861c-e35533c3b12c" returned: 0 in 0.350s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b06c910c-c410-424c-861c-e35533c3b12c" released by "delete_volume" :: held 1.078s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Created reservations ['ee7d7d91-95f5-4d0d-91c9-17f75012160f', 'ab800361-d9a3-4bc4-9750-a2067fe1174a', '73ec6288-d319-4a64-b7d9-accfe0886f0e', 'd05002c2-44f8-43c9-9716-00af5a6d3fd8'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:22 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:22 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:22 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.404s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:58:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d4814a6c-b004-4931-bf28-c8ee21cfc8a0 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-b06c910c-c410-424c-861c-e35533c3b12c-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (23b86c5e-16a3-4acc-a7f6-575d7b8711f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e44dfc-639b-4520-a153-5aa1a3e48205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e44dfc-639b-4520-a153-5aa1a3e48205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627711565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:24Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c775b33-23d8-485b-8e80-e747c6f5256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c775b33-23d8-485b-8e80-e747c6f5256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1717199c-294c-4e84-9a80-c70cceb002b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1717199c-294c-4e84-9a80-c70cceb002b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17', 'volume_name': 'volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da10a36-17a6-4c1e-a62d-f1bac16df4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da10a36-17a6-4c1e-a62d-f1bac16df4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad3a363-7f01-4e41-b9a2-601e038dff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:24 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Volume 9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17', 'volume_size': 1} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-627711565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:24Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Creating volume 9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:24 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:24 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 1073741824 Nov 02 09:58:24 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:24 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 1073741824" returned: 0 in 0.565s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:24 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 Nov 02 09:58:24 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:25 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" returned: 0 in 0.314s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad3a363-7f01-4e41-b9a2-601e038dff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1137d9b1-b28f-4186-af7b-c50de18a9cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:25 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Volume volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 (9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17): created successfully Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1137d9b1-b28f-4186-af7b-c50de18a9cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:25 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (23b86c5e-16a3-4acc-a7f6-575d7b8711f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d8ddccf9-cc0b-48c9-a897-f69ea213f66a tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 2f8b0fd4-ace6-4925-9565-c1e2c972c158 of volume 9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a379136-686f-4e09-9ba2-e9e6a3472f4c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:26 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 Nov 02 09:58:26 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:26 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:26 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 1G Nov 02 09:58:26 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:27 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 1G" returned: 0 in 0.573s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:27 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 Nov 02 09:58:27 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:27 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158" returned: 0 in 0.386s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:27 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 is being set with open permissions: ugo+rw Nov 02 09:58:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:27 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 Nov 02 09:58:27 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:28 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158" returned: 0 in 0.399s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:28 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info Nov 02 09:58:28 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:28 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:28 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info is being set with open permissions: ugo+rw Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:28 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info Nov 02 09:58:28 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:28 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.info" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:28 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.528s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:28 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e55b6e53-7e07-4143-a73d-f5a9d253a348 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-2f8b0fd4-ace6-4925-9565-c1e2c972c158-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-2f8b0fd4-ace6-4925-9565-c1e2c972c158-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-2f8b0fd4-ace6-4925-9565-c1e2c972c158" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2f8b0fd4-ace6-4925-9565-c1e2c972c158" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 2f8b0fd4-ace6-4925-9565-c1e2c972c158 of volume 9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[704473f6-fe7e-4715-9acd-95233c086410]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:29 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 Nov 02 09:58:29 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:30 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158" returned: 0 in 0.593s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed653fde-a8df-4711-bf5c-f701564f3e92]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:30 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 Nov 02 09:58:30 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:30 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" returned: 0 in 0.461s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:30 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 Nov 02 09:58:30 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:31 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158" returned: 0 in 0.448s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:31 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158 Nov 02 09:58:31 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:31 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17.2f8b0fd4-ace6-4925-9565-c1e2c972c158" returned: 0 in 0.311s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2f8b0fd4-ace6-4925-9565-c1e2c972c158" released by "_delete_snapshot" :: held 1.996s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" released by "delete_snapshot" :: held 2.028s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Created reservations ['37e4604d-6eab-4194-be26-f51782942d06', '12aababe-204d-4d14-9e5f-a5740d9bc20c', '07dff65e-7193-42f2-a1d0-b3a64a3bd978', '033fa620-0f4c-435d-a876-bcd267a0960d'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:31 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:58:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f5067709-8698-4a34-9e08-6049a065fbfa tempest-ProjectMemberTests-1087249574 None] Lock "cinder-2f8b0fd4-ace6-4925-9565-c1e2c972c158-delete_snapshot" released by "delete_snapshot" :: held 2.268s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "cinder-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec9591-fbc9-4e6b-a388-b2de5e40fa57]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:33 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 Nov 02 09:58:33 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:33 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" returned: 0 in 0.503s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:33 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17 Nov 02 09:58:33 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:33 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" returned: 0 in 0.342s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:33 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17" released by "delete_volume" :: held 0.968s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Created reservations ['2cbc9c95-222a-42ab-ac04-c0ff941abe18', '2878862c-7187-4e8d-bcfa-08aafc9d0168', 'a477f7f2-d08d-4073-bcfa-a5b7eab17c6b', 'adaf7c20-3794-49c4-9917-081034d21c27'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:34 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:34 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:34 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:34 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:58:34 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fd2a8610-c126-4613-bee8-6d69105b3bfb tempest-ProjectMemberTests-1087249574 None] Lock "cinder-9ffdd802-f0c5-45ef-bdec-5c3cf70bbf17-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (094687f6-6549-42ea-81f5-788742f8a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751881ea-e681-4679-abf4-1efecd8e8dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751881ea-e681-4679-abf4-1efecd8e8dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284282409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a08270-0107-4c4d-a833-68c03f2f238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:36Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3d0828-e7bd-4bcf-9a68-6fb911f1912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3d0828-e7bd-4bcf-9a68-6fb911f1912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4c5c4e-a854-4fd9-9d74-0e6819751491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4c5c4e-a854-4fd9-9d74-0e6819751491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a08270-0107-4c4d-a833-68c03f2f238e', 'volume_name': 'volume-b7a08270-0107-4c4d-a833-68c03f2f238e', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15a6d48-5bd2-4b57-a868-ec0e0fce56b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d15a6d48-5bd2-4b57-a868-ec0e0fce56b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2617b810-2afa-4452-8ccc-bfdf8d56ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:36 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Volume b7a08270-0107-4c4d-a833-68c03f2f238e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a08270-0107-4c4d-a833-68c03f2f238e', 'volume_size': 1} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284282409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a08270-0107-4c4d-a833-68c03f2f238e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:36Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Creating volume b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:36 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:36 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e 1073741824 Nov 02 09:58:36 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:36 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e 1073741824" returned: 0 in 0.658s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:37 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e Nov 02 09:58:37 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:37 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e" returned: 0 in 0.314s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2617b810-2afa-4452-8ccc-bfdf8d56ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a08270-0107-4c4d-a833-68c03f2f238e', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c46be0-040e-4f5b-b4d8-af613e0b281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Volume volume-b7a08270-0107-4c4d-a833-68c03f2f238e (b7a08270-0107-4c4d-a833-68c03f2f238e): created successfully Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c46be0-040e-4f5b-b4d8-af613e0b281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (094687f6-6549-42ea-81f5-788742f8a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c6ebc2f9-aeb5-479c-b226-e20df33456f6 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot eb42446e-4c03-4319-ad28-b2bb53e8b1a6 of volume b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cf3fe0-2003-42f1-9bc1-0e08c00497b9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:38 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e Nov 02 09:58:38 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:38 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e" returned: 0 in 0.450s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:38 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 1G Nov 02 09:58:38 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:39 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 1G" returned: 0 in 0.512s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a08270-0107-4c4d-a833-68c03f2f238e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:39 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a08270-0107-4c4d-a833-68c03f2f238e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 Nov 02 09:58:39 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (3948740f-42fd-433f-9faf-dec117e8cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f0af8-b40e-4199-877b-ce2099749d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f0af8-b40e-4199-877b-ce2099749d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727257808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94df56a0-71b5-4f0f-a598-99c7f33fd609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:39Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3572d85c-9ae8-411d-8688-c5b4079e3106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3572d85c-9ae8-411d-8688-c5b4079e3106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717d0f88-983a-49ad-abf3-4d516781c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (717d0f88-983a-49ad-abf3-4d516781c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94df56a0-71b5-4f0f-a598-99c7f33fd609', 'volume_name': 'volume-94df56a0-71b5-4f0f-a598-99c7f33fd609', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276140d0-e836-42cb-972d-1e236cb7f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276140d0-e836-42cb-972d-1e236cb7f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b458289-0365-4cc1-b34a-d02476243ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Volume 94df56a0-71b5-4f0f-a598-99c7f33fd609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94df56a0-71b5-4f0f-a598-99c7f33fd609', 'volume_size': 1} Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:39 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7a08270-0107-4c4d-a833-68c03f2f238e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:39 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 is being set with open permissions: ugo+rw Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:39 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 Nov 02 09:58:39 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:39 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:40 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info Nov 02 09:58:40 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:40 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:40 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info is being set with open permissions: ugo+rw Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:40 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info Nov 02 09:58:40 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:40 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.info" returned: 0 in 0.283s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.029s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727257808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94df56a0-71b5-4f0f-a598-99c7f33fd609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:39Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Creating volume 94df56a0-71b5-4f0f-a598-99c7f33fd609 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:40 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:40 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 1073741824 Nov 02 09:58:40 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1e55d549-4b59-4ad9-a4cf-b8aa9f6971b8 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:58:41 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 1073741824" returned: 0 in 0.612s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:41 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 Nov 02 09:58:41 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-eb42446e-4c03-4319-ad28-b2bb53e8b1a6-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:41 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-eb42446e-4c03-4319-ad28-b2bb53e8b1a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-eb42446e-4c03-4319-ad28-b2bb53e8b1a6" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b458289-0365-4cc1-b34a-d02476243ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94df56a0-71b5-4f0f-a598-99c7f33fd609', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be187902-614a-4359-9b3e-f6f0200baf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-eb42446e-4c03-4319-ad28-b2bb53e8b1a6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot eb42446e-4c03-4319-ad28-b2bb53e8b1a6 of volume b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:41 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Volume volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 (94df56a0-71b5-4f0f-a598-99c7f33fd609): created successfully Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be187902-614a-4359-9b3e-f6f0200baf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (3948740f-42fd-433f-9faf-dec117e8cabd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5981dd3-a178-482d-b3c9-761d6d0cc4de]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9106c2f8-b034-4f96-9518-e18b03bab977 tempest-ProjectReaderTests-1703289114 None] Created volume successfully. Nov 02 09:58:41 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 Nov 02 09:58:41 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:42 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6" returned: 0 in 0.435s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7a08270-0107-4c4d-a833-68c03f2f238e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a351d-1604-442e-9f8e-88b6963600c3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:42 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e Nov 02 09:58:42 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:42 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e" returned: 0 in 0.410s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:42 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 Nov 02 09:58:42 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-94df56a0-71b5-4f0f-a598-99c7f33fd609-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-94df56a0-71b5-4f0f-a598-99c7f33fd609-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-quobyte-94df56a0-71b5-4f0f-a598-99c7f33fd609" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-94df56a0-71b5-4f0f-a598-99c7f33fd609" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d0a6cc-856d-4ec2-ae0d-4d46f9bc25c0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:43 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 Nov 02 09:58:43 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:43 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6" returned: 0 in 0.484s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:43 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6 Nov 02 09:58:43 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:43 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609" returned: 0 in 0.463s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:43 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e.eb42446e-4c03-4319-ad28-b2bb53e8b1a6" returned: 0 in 0.325s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:43 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609 Nov 02 09:58:43 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-eb42446e-4c03-4319-ad28-b2bb53e8b1a6" released by "_delete_snapshot" :: held 1.858s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" released by "delete_snapshot" :: held 1.899s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Created reservations ['887ea3ff-8948-44e6-ad28-389f4f587628', '72f2e153-d7b6-4c2f-bf30-e5543a6b1701', '90993e11-5658-49c8-a2dc-26320f122a2c', '8c23dfdf-c216-4814-8b0e-16c55f261e7f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:43 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e77177f2-9067-4a7a-887e-d541321e9ae6 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-eb42446e-4c03-4319-ad28-b2bb53e8b1a6-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-b7a08270-0107-4c4d-a833-68c03f2f238e-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-b7a08270-0107-4c4d-a833-68c03f2f238e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:43 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-94df56a0-71b5-4f0f-a598-99c7f33fd609" returned: 0 in 0.584s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-94df56a0-71b5-4f0f-a598-99c7f33fd609" released by "delete_volume" :: held 1.105s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71b5d9-a397-4ea0-9b4e-cbf8a1bb5d9f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:43 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Created reservations ['e6e9bb51-b247-48d2-ab12-1e185ff79a7d', 'd3086180-0a39-4c7d-991c-e3a935299bf7', '46303d1c-4f97-4694-8a9d-4b315699bd45', '2fbc1a62-b667-4125-a7a5-c94c185a5c68'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:44 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e Nov 02 09:58:44 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:44 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e" returned: 0 in 0.523s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:44 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:44 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e Nov 02 09:58:44 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:44 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Deleted volume successfully. Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0ac49489-9fb8-49c9-a8a7-a86812350b84 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-94df56a0-71b5-4f0f-a598-99c7f33fd609-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:44 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-b7a08270-0107-4c4d-a833-68c03f2f238e" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-b7a08270-0107-4c4d-a833-68c03f2f238e" released by "delete_volume" :: held 0.921s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Created reservations ['bd7bae91-8cad-4c6c-8c6a-ab46bb994cf0', '35ed261c-90ed-4881-9935-1021d8b4b589', '14752bb6-4d43-48e8-a1e5-fcbd8adf8183', 'd4d78291-9925-4fbb-ab9f-48866435b4c1'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:44 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:45 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:45 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:45 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.360s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:45 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-5b2e2a99-8e0b-484c-be56-12d2197872e8 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-b7a08270-0107-4c4d-a833-68c03f2f238e-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (ff8c8e2d-5163-4305-b75f-33a705718d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234effec-df9c-47fb-937a-5cf2c79e49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234effec-df9c-47fb-937a-5cf2c79e49b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519613445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570cd0cd-ac07-4822-bdd0-24fe3ea7604b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:46Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b028ece-1a20-4863-a8f3-3401927b28cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b028ece-1a20-4863-a8f3-3401927b28cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641c6e09-3bcd-4637-9973-ef9be4b92c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641c6e09-3bcd-4637-9973-ef9be4b92c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570cd0cd-ac07-4822-bdd0-24fe3ea7604b', 'volume_name': 'volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f0157d-7c8d-4047-ac16-48c74dc09720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f0157d-7c8d-4047-ac16-48c74dc09720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f175dbe-55b7-40c2-8cf4-3e5043e414ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Volume 570cd0cd-ac07-4822-bdd0-24fe3ea7604b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b', 'volume_size': 1} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519613445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570cd0cd-ac07-4822-bdd0-24fe3ea7604b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:46Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Creating volume 570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:45 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b 1073741824 Nov 02 09:58:45 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (b5513654-7032-448c-84a5-7f11c82f4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2b3c0-04d9-45c7-b93e-ff8971b0c18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e2b3c0-04d9-45c7-b93e-ff8971b0c18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109224092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc7f93c-63a0-450f-ad86-c790086e8c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:46Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853a314e-34de-4168-bfd8-07c7f4db00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853a314e-34de-4168-bfd8-07c7f4db00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015d4dae-491e-4177-9f3b-b23e6b9ebaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015d4dae-491e-4177-9f3b-b23e6b9ebaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc7f93c-63a0-450f-ad86-c790086e8c42', 'volume_name': 'volume-bfc7f93c-63a0-450f-ad86-c790086e8c42', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62703f9c-3e1b-4a29-824f-71e9ae843cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62703f9c-3e1b-4a29-824f-71e9ae843cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56656a08-f281-4d96-a5c2-3ddd6941f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Volume bfc7f93c-63a0-450f-ad86-c790086e8c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc7f93c-63a0-450f-ad86-c790086e8c42', 'volume_size': 1} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:46 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b 1073741824" returned: 0 in 0.617s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:46 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b Nov 02 09:58:46 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:46 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" returned: 0 in 0.299s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-109224092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc7f93c-63a0-450f-ad86-c790086e8c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:46Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Creating volume bfc7f93c-63a0-450f-ad86-c790086e8c42 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:46 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:46 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 1073741824 Nov 02 09:58:46 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f175dbe-55b7-40c2-8cf4-3e5043e414ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f3a12-5216-427f-899b-bb51892256fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Volume volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b (570cd0cd-ac07-4822-bdd0-24fe3ea7604b): created successfully Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f3a12-5216-427f-899b-bb51892256fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (ff8c8e2d-5163-4305-b75f-33a705718d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d9f9905c-449f-4dfb-b85d-e116986bd337 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:58:47 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 1073741824" returned: 0 in 0.656s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:47 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 Nov 02 09:58:47 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:47 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56656a08-f281-4d96-a5c2-3ddd6941f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc7f93c-63a0-450f-ad86-c790086e8c42', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a4025-27ab-4dd0-b0c5-89a9d294f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:47 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Volume volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 (bfc7f93c-63a0-450f-ad86-c790086e8c42): created successfully Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1a4025-27ab-4dd0-b0c5-89a9d294f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:47 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (b5513654-7032-448c-84a5-7f11c82f4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:47 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-32f03b4f-b7b1-463d-8a9b-bb88193b4831 tempest-ProjectReaderTests-1703289114 None] Created volume successfully. Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 of volume 570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0469f6c2-10d0-4f42-a612-c49344062c98]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:48 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b Nov 02 09:58:48 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:48 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Flow 'volume_create_manager' (0447bc41-c253-4e0e-a7f5-28c5e15b700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efe2355-2bcb-4ebd-aa40-68599fec621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" returned: 0 in 0.491s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:48 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 1G Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efe2355-2bcb-4ebd-aa40-68599fec621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1211884659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab92f9a9-4f37-4884-822f-e2f7dbfeec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='046965c2ee1847d780ff6d4924e6c412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:48Z,use_quota=True,user_id='1b8f850a70464861b39ea53e47e89641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd41895-a1bd-4376-bbc5-fcaf117109d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd41895-a1bd-4376-bbc5-fcaf117109d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0f5916-34f8-4229-8964-78033fbc0333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0f5916-34f8-4229-8964-78033fbc0333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab92f9a9-4f37-4884-822f-e2f7dbfeec2a', 'volume_name': 'volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fd5281-ae2a-470e-bd99-d3deb340f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fd5281-ae2a-470e-bd99-d3deb340f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28abd10-24a6-4348-ab9e-c9362f42056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:48 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Volume ab92f9a9-4f37-4884-822f-e2f7dbfeec2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a', 'volume_size': 1} Nov 02 09:58:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:49 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 1G" returned: 0 in 0.463s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 Nov 02 09:58:49 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-bfc7f93c-63a0-450f-ad86-c790086e8c42-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "cinder-bfc7f93c-63a0-450f-ad86-c790086e8c42-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-quobyte-bfc7f93c-63a0-450f-ad86-c790086e8c42" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-bfc7f93c-63a0-450f-ad86-c790086e8c42" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69fca1d-7318-4987-bba4-c8bf8323b6bd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 is being set with open permissions: ugo+rw Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 Nov 02 09:58:49 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 Nov 02 09:58:49 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" returned: 0 in 0.295s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info Nov 02 09:58:49 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:49 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42" returned: 0 in 0.410s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:49 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42 Nov 02 09:58:49 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info" returned: 0 in 0.292s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info is being set with open permissions: ugo+rw Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:50 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info Nov 02 09:58:50 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-bfc7f93c-63a0-450f-ad86-c790086e8c42" returned: 0 in 0.274s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-bfc7f93c-63a0-450f-ad86-c790086e8c42" released by "delete_volume" :: held 0.745s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Created reservations ['9ea09430-cb26-494c-9c6f-7f69eb84260e', '30eeb1bc-df5e-42d1-b768-65262318bbc7', '2395b239-e198-40d3-8ebe-6d973890466c', 'e79b2bff-8a7e-4f52-91ec-1a92bd4e3877'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:50 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:50 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.info" returned: 0 in 0.317s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1211884659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab92f9a9-4f37-4884-822f-e2f7dbfeec2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='046965c2ee1847d780ff6d4924e6c412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:48Z,use_quota=True,user_id='1b8f850a70464861b39ea53e47e89641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Creating volume ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:50 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:50 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a 1073741824 Nov 02 09:58:50 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-99896e41-956b-43b8-a211-502c72e2f0b6 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:58:50 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.359s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:50 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Deleted volume successfully. Nov 02 09:58:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-d0243ef6-1e97-4073-bd90-6acee38b41ab tempest-ProjectReaderTests-1703289114 None] Lock "cinder-bfc7f93c-63a0-450f-ad86-c790086e8c42-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:51 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a 1073741824" returned: 0 in 0.607s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (84d825cd-4dd2-4e8c-865d-d4d69170a119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c1664c-3423-47fe-a298-d6e799a28ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c1664c-3423-47fe-a298-d6e799a28ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893993096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfba0abc-4d8e-47ee-b1a9-c63c49e9be27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:51Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9743e8a0-aed6-493b-bb1c-ff9c80242df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9743e8a0-aed6-493b-bb1c-ff9c80242df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:58:51 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2377ed-a6e0-4798-8f76-395f930999fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2377ed-a6e0-4798-8f76-395f930999fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfba0abc-4d8e-47ee-b1a9-c63c49e9be27', 'volume_name': 'volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0359e3-2e38-4124-a3bf-8631a31997ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0359e3-2e38-4124-a3bf-8631a31997ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f3e36-8ae9-4d03-9d50-c23c2e3b8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Volume dfba0abc-4d8e-47ee-b1a9-c63c49e9be27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27', 'volume_size': 1} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 of volume 570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[279d93a3-dba2-4f93-88d1-38b12e51d4a4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:51 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.297s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893993096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfba0abc-4d8e-47ee-b1a9-c63c49e9be27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:51Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Creating volume dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:51 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:51 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 1073741824 Nov 02 09:58:51 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28abd10-24a6-4348-ab9e-c9362f42056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1441a74-fd5b-4432-89db-a427204b8de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:51 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 Nov 02 09:58:51 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:51 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Volume volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a (ab92f9a9-4f37-4884-822f-e2f7dbfeec2a): created successfully Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1441a74-fd5b-4432-89db-a427204b8de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Flow 'volume_create_manager' (0447bc41-c253-4e0e-a7f5-28c5e15b700d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:51 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-498fd4cd-7202-4901-a0b7-7aba40e8fc8a tempest-SnapshotDependencyTests-1947119567 None] Created volume successfully. Nov 02 09:58:51 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" returned: 0 in 0.430s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd44050-4ca7-4912-bbfd-81dbd8f35cc7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b Nov 02 09:58:52 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:52 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 1073741824" returned: 0 in 0.655s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 Nov 02 09:58:52 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" returned: 0 in 0.536s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 Nov 02 09:58:52 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" returned: 0 in 0.304s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Creating offline snapshot 90d07864-d69d-49cb-ab4c-714fd84b9135 of volume ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672f3e36-8ae9-4d03-9d50-c23c2e3b8574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3eafd1-dc43-4666-9faf-ad38d1bf7c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[465aa8bc-2c03-43ac-be4f-ce2f4ce143e3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Volume volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 (dfba0abc-4d8e-47ee-b1a9-c63c49e9be27): created successfully Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3eafd1-dc43-4666-9faf-ad38d1bf7c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (84d825cd-4dd2-4e8c-865d-d4d69170a119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-67b8aa24-12ad-478b-b53c-a1af43a98783 tempest-ProjectReaderTests-1703289114 None] Created volume successfully. Nov 02 09:58:52 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:58:52 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" returned: 0 in 0.440s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:52 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24 Nov 02 09:58:52 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:52 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.497s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 1G Nov 02 09:58:53 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:53 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b.1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" returned: 0 in 0.325s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24" released by "_delete_snapshot" :: held 1.896s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" released by "delete_snapshot" :: held 1.927s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Created reservations ['b69f5b9e-102c-43bc-b69b-3fe63f2c74a5', 'fa899d31-7008-4c7a-8d53-d777a40e40fb', 'dee56a69-474e-47f7-83ec-28458518c0cb', '71bcc3f3-2014-425e-8b86-0e144f633524'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "cinder-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-quobyte-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" acquired by "delete_volume" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-0630fef7-61a8-420a-a70e-d87dcbe3d711 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-1ca366a3-333b-4dfa-9bec-ae6faa9b4f24-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a660f84a-e4c3-4a34-9b3e-e2621bfdd0dd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-570cd0cd-ac07-4822-bdd0-24fe3ea7604b-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-570cd0cd-ac07-4822-bdd0-24fe3ea7604b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 1G" returned: 0 in 0.657s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 Nov 02 09:58:53 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:53 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:58:53 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6712ce4-0d36-4b18-83e0-005f0056c6b9]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b Nov 02 09:58:53 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:53 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" returned: 0 in 0.483s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.346s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:53 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 is being set with open permissions: ugo+rw Nov 02 09:58:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:53 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27 Nov 02 09:58:53 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:58:54 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b Nov 02 09:58:54 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27" released by "delete_volume" :: held 0.903s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info Nov 02 09:58:54 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Created reservations ['6a2b7fd9-b1bd-437f-8740-2ecd035aa029', 'efe44d18-7a94-450c-9d88-788457c389fe', '3a15b905-d051-43df-bac4-1a9841c76940', '6e7014b5-b254-499f-9fef-79667c9839f4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:54 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" returned: 0 in 0.337s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-570cd0cd-ac07-4822-bdd0-24fe3ea7604b" released by "delete_volume" :: held 0.893s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:54 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Created reservations ['d1d17fb0-a3ed-4a81-841e-e155599dbdfe', 'd5adfb1c-2da4-4e1c-9e4a-e7aeb3012472', 'f3739d35-05d3-4c6b-bca2-0831a625d15b', '3f999b49-06df-47bf-ac83-e03992a27ba4'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:58:54 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info" returned: 0 in 0.370s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info is being set with open permissions: ugo+rw Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:54 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info Nov 02 09:58:54 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:54 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:54 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.338s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:54 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Deleted volume successfully. Nov 02 09:58:54 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-487fa534-b4ef-4148-9cfc-5a57e2f8d25f tempest-ProjectReaderTests-1703289114 None] Lock "cinder-dfba0abc-4d8e-47ee-b1a9-c63c49e9be27-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:55 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.info" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.616s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:55 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.294s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:58:55 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-74b97831-f0c4-4a98-9538-a41a923f3089 tempest-SnapshotDependencyTests-1947119567 None] Create snapshot completed successfully Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-57d05665-254f-4d81-9df3-5f7234197946 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-570cd0cd-ac07-4822-bdd0-24fe3ea7604b-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:58:55 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Flow 'volume_create_manager' (6c8cc750-92d5-4116-9633-5a5f75297351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64c597-d8c8-4b86-a41a-7a854dd435cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64c597-d8c8-4b86-a41a-7a854dd435cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d46ae4-44cf-437d-b643-0e67922017ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='046965c2ee1847d780ff6d4924e6c412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90d07864-d69d-49cb-ab4c-714fd84b9135,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:56Z,use_quota=True,user_id='1b8f850a70464861b39ea53e47e89641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5732a9ef-87c8-44aa-a37a-46dff869aedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5732a9ef-87c8-44aa-a37a-46dff869aedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a371cdd6-a87f-42d2-949e-e0e5b4f0ed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a371cdd6-a87f-42d2-949e-e0e5b4f0ed43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63d46ae4-44cf-437d-b643-0e67922017ff', 'volume_name': 'volume-63d46ae4-44cf-437d-b643-0e67922017ff', 'volume_size': 1, 'snapshot_id': '90d07864-d69d-49cb-ab4c-714fd84b9135'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ab2a9b-a91d-463f-8f9c-191aedeb5aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ab2a9b-a91d-463f-8f9c-191aedeb5aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a28532-6a96-4a43-8608-110c54bf05ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Volume 63d46ae4-44cf-437d-b643-0e67922017ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63d46ae4-44cf-437d-b643-0e67922017ff', 'volume_size': 1, 'snapshot_id': '90d07864-d69d-49cb-ab4c-714fd84b9135'} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135-63d46ae4-44cf-437d-b643-0e67922017ff" by "_create_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135-63d46ae4-44cf-437d-b643-0e67922017ff" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Creating volume 63d46ae4-44cf-437d-b643-0e67922017ff from snapshot 90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" by "_copy_volume_from_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] snapshot: 90d07864-d69d-49cb-ab4c-714fd84b9135, volume: 63d46ae4-44cf-437d-b643-0e67922017ff, {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e835d062-1b21-40b1-bf01-f524d9771e5e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (12691e81-c556-45ec-933f-87bf41c84a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a9b585-1ffe-4397-a0a3-af2bc3bd7c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a9b585-1ffe-4397-a0a3-af2bc3bd7c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244131547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03799d51-f1d6-4a82-b4c1-34e44d2a668a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:56Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e1fb54-5612-4687-a571-6b75b4f486e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e1fb54-5612-4687-a571-6b75b4f486e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44acbc5-dd27-4be3-9136-89bd02773a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:58:56 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44acbc5-dd27-4be3-9136-89bd02773a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03799d51-f1d6-4a82-b4c1-34e44d2a668a', 'volume_name': 'volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09391ba-9082-425d-820b-3f66b9dd1ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09391ba-9082-425d-820b-3f66b9dd1ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0a44e6-1d05-4ec2-b0fb-4dd06254f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Volume 03799d51-f1d6-4a82-b4c1-34e44d2a668a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a', 'volume_size': 1} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (ce70fb1a-ddc6-4658-963c-2f442c08134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae5c89f-4855-4218-8432-35c480a0d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae5c89f-4855-4218-8432-35c480a0d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115944844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0a583c-467e-4ef4-a10d-9927f81025d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:57Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fac7f-9286-480c-a435-6e5643f75c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507fac7f-9286-480c-a435-6e5643f75c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4163a1-55f1-4f1d-bab6-3689145ce09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4163a1-55f1-4f1d-bab6-3689145ce09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0a583c-467e-4ef4-a10d-9927f81025d0', 'volume_name': 'volume-1a0a583c-467e-4ef4-a10d-9927f81025d0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fd00f4-f106-4bb6-97e9-9815287b87aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fd00f4-f106-4bb6-97e9-9815287b87aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b84e5c-25e0-43cd-ba65-9b3078d186d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:58:56 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Volume 1a0a583c-467e-4ef4-a10d-9927f81025d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0a583c-467e-4ef4-a10d-9927f81025d0', 'volume_size': 1} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:56 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.408s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bf668-5085-415f-bcca-bf2def37cedf]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:58:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:56 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:58:56 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:57 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.360s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 09:58:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Creating direct copy from snapshot {{(pid=86887) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 09:58:57 devstack cinder-volume[86887]: DEBUG cinder.utils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Path /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff not found in is_blk_device check {{(pid=86887) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 09:58:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:57 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff Nov 02 09:58:57 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:58:58 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:58:58 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:58:58 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.353s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:58:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:59:03 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff" returned: 0 in 6.376s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.image.image_utils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Image conversion details: src /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff {{(pid=86887) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 09:59:03 devstack cinder-volume[86887]: INFO cinder.image.image_utils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Converted 1024.00 MB image at 160.57 MB/s Nov 02 09:59:03 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff is being set with open permissions: ugo+rw Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:03 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff Nov 02 09:59:03 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:03 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff" returned: 0 in 0.263s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" released by "_copy_volume_from_snapshot" :: held 7.540s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135-63d46ae4-44cf-437d-b643-0e67922017ff" released by "_create_volume_from_snapshot" :: held 7.627s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.663s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.336s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244131547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03799d51-f1d6-4a82-b4c1-34e44d2a668a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53accb3c071b40a58b570793268a3569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:56Z,use_quota=True,user_id='5ca82bace53949b19adb8d8294460411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Creating volume 03799d51-f1d6-4a82-b4c1-34e44d2a668a {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:03 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:03 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a 1073741824 Nov 02 09:59:03 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a28532-6a96-4a43-8608-110c54bf05ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d46ae4-44cf-437d-b643-0e67922017ff', 'volume_size': 1, 'snapshot_id': '90d07864-d69d-49cb-ab4c-714fd84b9135'}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a589ea3-7ccd-4e16-adb7-b6e8d80f86cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:03 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Volume volume-63d46ae4-44cf-437d-b643-0e67922017ff (63d46ae4-44cf-437d-b643-0e67922017ff): created successfully Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a589ea3-7ccd-4e16-adb7-b6e8d80f86cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:03 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Flow 'volume_create_manager' (6c8cc750-92d5-4116-9633-5a5f75297351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:03 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-dcbb7f73-e449-41f9-919c-100aeb367cab tempest-SnapshotDependencyTests-1947119567 None] Created volume successfully. Nov 02 09:59:04 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a 1073741824" returned: 0 in 0.485s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:04 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a Nov 02 09:59:04 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:04 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a" returned: 0 in 0.249s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.937s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115944844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0a583c-467e-4ef4-a10d-9927f81025d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:58:57Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Creating volume 1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:04 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0a44e6-1d05-4ec2-b0fb-4dd06254f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:04 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 1073741824 Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa0cd0c-d9c7-4599-a197-cdbb525b0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:04 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:04 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Volume volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a (03799d51-f1d6-4a82-b4c1-34e44d2a668a): created successfully Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa0cd0c-d9c7-4599-a197-cdbb525b0513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Flow 'volume_create_manager' (12691e81-c556-45ec-933f-87bf41c84a72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:04 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-59489a88-f1f5-41d0-81a6-94905805d379 tempest-ProjectReaderTests-1703289114 None] Created volume successfully. Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-90d07864-d69d-49cb-ab4c-714fd84b9135-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-90d07864-d69d-49cb-ab4c-714fd84b9135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Deleting offline snapshot 90d07864-d69d-49cb-ab4c-714fd84b9135 of volume ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] snapshot_file for this snap is: volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[48216322-55a3-45da-9ed8-4dbbc10e0c50]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:04 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-03799d51-f1d6-4a82-b4c1-34e44d2a668a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:05 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:59:05 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-03799d51-f1d6-4a82-b4c1-34e44d2a668a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "cinder-quobyte-03799d51-f1d6-4a82-b4c1-34e44d2a668a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-03799d51-f1d6-4a82-b4c1-34e44d2a668a" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549c89e-f5e4-427e-9be0-41ae299a757f]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:05 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 1073741824" returned: 0 in 0.558s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:05 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 Nov 02 09:59:05 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a Nov 02 09:59:05 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.448s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54dc0b-5d22-4cae-8cbe-19abf7aa5940]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:05 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:59:05 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b84e5c-25e0-43cd-ba65-9b3078d186d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0a583c-467e-4ef4-a10d-9927f81025d0', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21428c-aa53-42ea-875e-fe9e64edebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:05 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Volume volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 (1a0a583c-467e-4ef4-a10d-9927f81025d0): created successfully Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b21428c-aa53-42ea-875e-fe9e64edebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (ce70fb1a-ddc6-4658-963c-2f442c08134e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1abaf974-7516-4827-9556-afadf42e6691 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:59:05 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a" returned: 0 in 0.437s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:05 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a Nov 02 09:59:05 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:05 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-03799d51-f1d6-4a82-b4c1-34e44d2a668a" returned: 0 in 0.264s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-quobyte-03799d51-f1d6-4a82-b4c1-34e44d2a668a" released by "delete_volume" :: held 0.758s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Created reservations ['3065ee87-897b-4d2b-8bdd-732bcf89732c', '927fe4e8-0577-433a-84e7-54a8848c424f', 'a6348029-9c5b-48be-b577-681224f05dfd', 'd88a8cab-4e9c-4d62-b606-2d92a09accbb'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:05 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.628s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:05 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:06 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:06 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:06 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:06 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:06 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.299s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Deleted volume successfully. Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-98bb9ad2-15b7-451e-bfd7-17f99ed1ff52 tempest-ProjectReaderTests-1703289114 None] Lock "cinder-03799d51-f1d6-4a82-b4c1-34e44d2a668a-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:06 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.425s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:06 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135 Nov 02 09:59:06 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot cd390ddd-1ae5-415a-a9a1-96734e99c782 of volume 1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a046886-ef54-4b3a-9a50-c82a37cbb879]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:06 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a.90d07864-d69d-49cb-ab4c-714fd84b9135" returned: 0 in 0.351s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:06 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 Nov 02 09:59:06 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-90d07864-d69d-49cb-ab4c-714fd84b9135" released by "_delete_snapshot" :: held 1.985s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" released by "delete_snapshot" :: held 2.013s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Created reservations ['55d4f89d-ace5-41c4-af1e-f082f2f2ff80', '1cbb5270-3819-4b67-91ab-f881a4593570', '8a6b0a54-d5fe-4904-a66a-e96e98b943e7', '5b27a79a-339e-4552-ae95-0a039eef5545'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:06 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Delete snapshot completed successfully. Nov 02 09:59:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-184e6b25-1790-499c-a545-10cef5df3c37 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-90d07864-d69d-49cb-ab4c-714fd84b9135-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:07 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0" returned: 0 in 0.455s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:07 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 1G Nov 02 09:59:07 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:07 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 1G" returned: 0 in 0.497s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:07 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 Nov 02 09:59:07 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:07 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:07 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 is being set with open permissions: ugo+rw Nov 02 09:59:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:07 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 Nov 02 09:59:07 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" acquired by "delete_volume" :: waited 0.023s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ab093-9732-48ed-9aeb-407e4bd25b60]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:08 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782" returned: 0 in 0.369s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:08 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:59:08 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:08 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info Nov 02 09:59:08 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:08 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:08 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info is being set with open permissions: ugo+rw Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:08 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.476s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:08 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info Nov 02 09:59:08 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:08 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a Nov 02 09:59:08 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:08 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" returned: 0 in 0.286s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:08 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.info" returned: 0 in 0.326s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a" released by "delete_volume" :: held 0.884s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-8d78dbfe-9335-497e-ba6e-e9e383b7f8d7 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Created reservations ['7fdaa030-fb0f-4e66-ab7c-9eaa9b901668', '1e8035d0-4323-4841-8133-29a9dbe5d02e', 'f7eb8d2f-3568-4221-9fbd-39700d26fe5a', 'b4748498-d563-4608-aaeb-11b952cff98f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:09 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:09 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-63d46ae4-44cf-437d-b643-0e67922017ff-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-63d46ae4-44cf-437d-b643-0e67922017ff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf38f3-c567-4f88-b440-72cd5c0a47fd]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:09 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:09 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Deleted volume successfully. Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-90218e61-1959-4072-bab7-6e4c4061a172 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-ab92f9a9-4f37-4884-822f-e2f7dbfeec2a-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:09 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff Nov 02 09:59:09 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-cd390ddd-1ae5-415a-a9a1-96734e99c782-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-cd390ddd-1ae5-415a-a9a1-96734e99c782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:09 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff" returned: 0 in 0.441s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-cd390ddd-1ae5-415a-a9a1-96734e99c782" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:09 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff Nov 02 09:59:09 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-cd390ddd-1ae5-415a-a9a1-96734e99c782" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot cd390ddd-1ae5-415a-a9a1-96734e99c782 of volume 1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafdb118-c832-439a-b4e1-a17fc6b21726]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:10 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 Nov 02 09:59:10 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:10 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-63d46ae4-44cf-437d-b643-0e67922017ff" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-quobyte-63d46ae4-44cf-437d-b643-0e67922017ff" released by "delete_volume" :: held 0.762s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=110,cinder:INSERT=38,cinder:UPDATE=147,cinder:DELETE=15 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=154,cinder:SELECT=121,cinder:INSERT=39,cinder:DELETE=12 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Created reservations ['27484577-24ea-468e-bcb4-6252b5052a6c', '9d792033-407f-410b-9f3c-678f76405009', '1d896d5f-a0f7-46b3-827b-a993340c98b3', 'eca9bcb8-0986-454a-9f14-5f02a8f0caab'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:10 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:10 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:10 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782" returned: 0 in 0.412s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0a583c-467e-4ef4-a10d-9927f81025d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb1c43-dbf8-4f2b-b5a6-12180c552290]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:10 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 Nov 02 09:59:10 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:10 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.301s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Deleted volume successfully. Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fc6981b0-74e0-4c0e-8ad5-83955d940fb8 tempest-SnapshotDependencyTests-1947119567 None] Lock "cinder-63d46ae4-44cf-437d-b643-0e67922017ff-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:10 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0" returned: 0 in 0.460s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:10 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 Nov 02 09:59:10 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:11 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782" returned: 0 in 0.449s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:11 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782 Nov 02 09:59:11 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:11 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0.cd390ddd-1ae5-415a-a9a1-96734e99c782" returned: 0 in 0.295s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-cd390ddd-1ae5-415a-a9a1-96734e99c782" released by "_delete_snapshot" :: held 1.751s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" released by "delete_snapshot" :: held 1.778s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Created reservations ['22b73475-3f6d-4c86-8d2b-1dbc5dab217d', '6cc4e3b9-10c1-419b-89bb-c9c0291d929a', '67215f7d-8719-4e8b-9f68-4593ae4bace1', 'f893ea85-1749-4730-80fa-0488335c63de'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:59:11 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-316efa17-0e46-44a2-a2e3-3c2ea61aa849 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-cd390ddd-1ae5-415a-a9a1-96734e99c782-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-1a0a583c-467e-4ef4-a10d-9927f81025d0-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-1a0a583c-467e-4ef4-a10d-9927f81025d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" acquired by "delete_volume" :: waited 0.027s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ad7a7-f879-41f2-8e4b-b03af53e2153]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:12 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 Nov 02 09:59:12 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:12 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0" returned: 0 in 0.447s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:12 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0 Nov 02 09:59:12 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:12 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1a0a583c-467e-4ef4-a10d-9927f81025d0" returned: 0 in 0.312s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:12 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-1a0a583c-467e-4ef4-a10d-9927f81025d0" released by "delete_volume" :: held 0.840s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Created reservations ['912c64c8-c9b7-4a8e-976b-f7f7886c514e', '83a301d5-6b2e-43dd-91fe-7ee03b1dc270', '4432d2cc-1266-4f7e-b1ba-485d476d1b10', '1399f050-249c-4475-9e82-51bd4ae3a428'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:13 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:13 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:13 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-53e5a52d-b4e4-4b96-a859-bc6a908a3729 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-1a0a583c-467e-4ef4-a10d-9927f81025d0-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (eca9d9df-7042-4178-8e42-6a07d8eb7674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b023cdd9-e119-4e69-9337-6abff1dc3ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b023cdd9-e119-4e69-9337-6abff1dc3ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528882555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6dc0c3-b514-4914-a787-22aa3f0c3256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:14Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05af822-40a8-43f4-8424-42c6384f15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05af822-40a8-43f4-8424-42c6384f15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b54e6-a159-422a-9f00-a01661221a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9b54e6-a159-422a-9f00-a01661221a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6dc0c3-b514-4914-a787-22aa3f0c3256', 'volume_name': 'volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f60f1a9-0cd1-4da4-8ef8-df662a04cad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f60f1a9-0cd1-4da4-8ef8-df662a04cad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68236f00-d6b0-4216-86a1-14f3a3a0c82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:13 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Volume ed6dc0c3-b514-4914-a787-22aa3f0c3256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256', 'volume_size': 1} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1528882555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6dc0c3-b514-4914-a787-22aa3f0c3256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:14Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Creating volume ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:13 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:13 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 1073741824 Nov 02 09:59:13 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:14 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 1073741824" returned: 0 in 0.486s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:14 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 Nov 02 09:59:14 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:14 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256" returned: 0 in 0.340s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68236f00-d6b0-4216-86a1-14f3a3a0c82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d71c41-1197-4053-964e-c14f57db7340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:14 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Volume volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 (ed6dc0c3-b514-4914-a787-22aa3f0c3256): created successfully Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d71c41-1197-4053-964e-c14f57db7340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:14 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (eca9d9df-7042-4178-8e42-6a07d8eb7674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:14 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-35ed7fe6-e75e-47da-bbaa-2ee014908574 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c of volume ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c8cab5-d9d8-4acb-a3c7-e06e340ab252]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:16 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 Nov 02 09:59:16 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:16 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256" returned: 0 in 0.440s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:16 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c 1G Nov 02 09:59:16 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:17 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c 1G" returned: 0 in 0.529s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:17 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c Nov 02 09:59:17 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:17 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:17 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c is being set with open permissions: ugo+rw Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:17 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c Nov 02 09:59:17 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:17 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:18 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info Nov 02 09:59:18 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:18 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info" returned: 0 in 0.298s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:18 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info is being set with open permissions: ugo+rw Nov 02 09:59:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:18 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info Nov 02 09:59:18 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:18 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.info" returned: 0 in 0.334s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1a24b5fd-5bfb-407a-a98e-f26376706162 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c of volume ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44bed80-4c03-4381-a60a-84bc3caed328]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:19 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c Nov 02 09:59:19 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:19 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" returned: 0 in 0.384s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e26bbcf-348f-43b1-8a23-3fdcad7babb3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:20 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 Nov 02 09:59:20 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:20 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256" returned: 0 in 0.474s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:20 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c Nov 02 09:59:20 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:20 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:20 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c Nov 02 09:59:20 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:21 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256.e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c" released by "_delete_snapshot" :: held 1.678s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" released by "delete_snapshot" :: held 1.706s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Created reservations ['32b1d54f-f81e-4b77-8f1c-1b8181512c9b', '23988a28-0d59-418b-9dcc-8eb78de0db4d', 'b7db8c8f-c5c0-4cd0-b339-c850af3ae185', 'd9e8321b-06eb-4d14-81aa-8b061fac7455'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-aa1d0c10-a1ab-4b3e-a7aa-75388ec87261 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-e9d9cbdd-d84d-4b95-96b1-b4916ab48f3c-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-ed6dc0c3-b514-4914-a787-22aa3f0c3256-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-ed6dc0c3-b514-4914-a787-22aa3f0c3256-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" acquired by "delete_volume" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[69484b9a-1f92-4dbd-9f45-e9e49982d245]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:21 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 Nov 02 09:59:21 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:22 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:22 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256 Nov 02 09:59:22 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:22 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-ed6dc0c3-b514-4914-a787-22aa3f0c3256" returned: 0 in 0.306s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-ed6dc0c3-b514-4914-a787-22aa3f0c3256" released by "delete_volume" :: held 0.766s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Created reservations ['4925aa40-0608-4a14-8a5b-95ac86d4a767', '1cb9219f-35b2-4c88-886f-29f810e2f42d', '64c54a99-da38-4ddb-859f-90005971285f', '446152f1-04ac-4f60-9b47-2361cbdf3740'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:22 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:22 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:22 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.296s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:22 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:59:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-fcc8e106-cbf4-4c31-8660-d5607af81b47 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-ed6dc0c3-b514-4914-a787-22aa3f0c3256-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (49170917-908f-455b-983a-e62f20c2a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870f5e78-7c27-46cb-8797-a73faa48b305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870f5e78-7c27-46cb-8797-a73faa48b305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914378332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eef6e23-034c-4b0f-b1b5-83ef514f4433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:23Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6990e4c-c93c-434a-a68f-76d78660c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6990e4c-c93c-434a-a68f-76d78660c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2740b6-f494-4175-8106-1d4a4b9581fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e2740b6-f494-4175-8106-1d4a4b9581fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eef6e23-034c-4b0f-b1b5-83ef514f4433', 'volume_name': 'volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fb667d-21bb-4a8a-9248-cb8148bf3921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90fb667d-21bb-4a8a-9248-cb8148bf3921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1a5fca-bf75-483f-9a95-448eb67708c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:23 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Volume 2eef6e23-034c-4b0f-b1b5-83ef514f4433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433', 'volume_size': 1} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-914378332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eef6e23-034c-4b0f-b1b5-83ef514f4433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:23Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Creating volume 2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:23 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:23 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 1073741824 Nov 02 09:59:23 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:24 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 1073741824" returned: 0 in 0.523s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:24 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 Nov 02 09:59:24 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:24 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433" returned: 0 in 0.314s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1a5fca-bf75-483f-9a95-448eb67708c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b0860-3e84-4a45-b7d8-80230c7a7afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:24 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Volume volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 (2eef6e23-034c-4b0f-b1b5-83ef514f4433): created successfully Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b0860-3e84-4a45-b7d8-80230c7a7afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:24 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (49170917-908f-455b-983a-e62f20c2a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:24 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4bd5795b-5399-4bbc-9f53-b522b3c813ed tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:59:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 14a4821c-f437-4960-91af-0f908fc2d522 of volume 2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:25 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa9963-4755-4c83-8f60-3e5511f9c667]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:25 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 Nov 02 09:59:25 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:26 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433" returned: 0 in 0.388s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:26 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 1G Nov 02 09:59:26 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:26 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 1G" returned: 0 in 0.430s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:26 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 Nov 02 09:59:26 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:26 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522" returned: 0 in 0.313s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:26 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 is being set with open permissions: ugo+rw Nov 02 09:59:26 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:26 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 Nov 02 09:59:26 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522" returned: 0 in 0.250s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:27 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info Nov 02 09:59:27 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info" returned: 0 in 0.270s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:27 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info is being set with open permissions: ugo+rw Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:27 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info Nov 02 09:59:27 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:27 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.info" returned: 0 in 0.271s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:27 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:27 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-27df0a29-a13c-487e-bcbe-f8cedf385d66 tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-14a4821c-f437-4960-91af-0f908fc2d522-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-14a4821c-f437-4960-91af-0f908fc2d522-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-14a4821c-f437-4960-91af-0f908fc2d522" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:28 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-14a4821c-f437-4960-91af-0f908fc2d522" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 14a4821c-f437-4960-91af-0f908fc2d522 of volume 2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23e7b4-fc84-4408-bcf9-9acd6693c5f7]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:29 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 Nov 02 09:59:29 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:29 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522" returned: 0 in 0.521s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24f867a-a0ab-4751-8f98-e2ce90c11c2a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:29 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:29 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 Nov 02 09:59:29 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:30 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433" returned: 0 in 0.462s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:30 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 Nov 02 09:59:30 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:30 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522" returned: 0 in 0.422s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:30 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522 Nov 02 09:59:30 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:30 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433.14a4821c-f437-4960-91af-0f908fc2d522" returned: 0 in 0.276s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-14a4821c-f437-4960-91af-0f908fc2d522" released by "_delete_snapshot" :: held 1.814s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" released by "delete_snapshot" :: held 1.842s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Created reservations ['b03cad2b-55b0-4b95-93d1-1f2f2b128d6f', '27d9a4dd-1124-4e97-b4dd-478ec7872c9e', '3c062320-1f1a-4f91-ad71-522e8d7a9942', '154e3068-7176-4e3f-9a56-ed74cb39b734'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:30 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:59:30 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-7d9e57b6-636a-4fc7-8c95-dd2fe4789a71 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-14a4821c-f437-4960-91af-0f908fc2d522-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-2eef6e23-034c-4b0f-b1b5-83ef514f4433-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "cinder-2eef6e23-034c-4b0f-b1b5-83ef514f4433-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74680f-57bb-4d0c-a1d4-2fece293f8cf]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:31 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 Nov 02 09:59:31 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:31 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433" returned: 0 in 0.442s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:31 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433 Nov 02 09:59:31 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:31 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-2eef6e23-034c-4b0f-b1b5-83ef514f4433" returned: 0 in 0.292s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:31 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-2eef6e23-034c-4b0f-b1b5-83ef514f4433" released by "delete_volume" :: held 0.809s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Created reservations ['1c5dc9ff-1b8d-4b33-8c0c-773edd1e7e25', '0a8bea30-da8f-4db5-ae6d-d44e264e450f', 'b1b38393-fb28-4120-aa1e-1d7636cb6060', '28c36d89-f1a5-4989-9404-1299a8ce93c8'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:32 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:32 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:32 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.302s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:32 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c2c3d79a-2dde-459c-92d7-6bc914537e4e tempest-ProjectMemberTests-1087249574 None] Lock "cinder-2eef6e23-034c-4b0f-b1b5-83ef514f4433-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (c02753ca-41a9-4096-abe4-6a21ed6d9e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bcb699-38e5-41cb-b231-b4f1d56e9957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bcb699-38e5-41cb-b231-b4f1d56e9957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005794717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488f0874-0183-4e84-80a0-4c3aa753f39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:33Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9eda7d-10ca-4b99-9fa2-d75dd7b3d044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9eda7d-10ca-4b99-9fa2-d75dd7b3d044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af31491-9996-407d-a16f-43a1ddcaec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af31491-9996-407d-a16f-43a1ddcaec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488f0874-0183-4e84-80a0-4c3aa753f39e', 'volume_name': 'volume-488f0874-0183-4e84-80a0-4c3aa753f39e', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dcfdd4-75d4-4d59-8817-2812ffc2d22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27dcfdd4-75d4-4d59-8817-2812ffc2d22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf1906c-4378-44b4-a0bd-31b27f1fbd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:32 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Volume 488f0874-0183-4e84-80a0-4c3aa753f39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488f0874-0183-4e84-80a0-4c3aa753f39e', 'volume_size': 1} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005794717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488f0874-0183-4e84-80a0-4c3aa753f39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02eaff375f7843df87140169813b03a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:33Z,use_quota=True,user_id='fb3b1a1c862f473d8f3a63695d6ee95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Creating volume 488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:32 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:32 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:32 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e 1073741824 Nov 02 09:59:32 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:33 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e 1073741824" returned: 0 in 0.448s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:33 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e Nov 02 09:59:33 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:33 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf1906c-4378-44b4-a0bd-31b27f1fbd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488f0874-0183-4e84-80a0-4c3aa753f39e', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a55143c-51d0-42f0-8b77-7a77374c5403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:33 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Volume volume-488f0874-0183-4e84-80a0-4c3aa753f39e (488f0874-0183-4e84-80a0-4c3aa753f39e): created successfully Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a55143c-51d0-42f0-8b77-7a77374c5403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:33 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Flow 'volume_create_manager' (c02753ca-41a9-4096-abe4-6a21ed6d9e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:33 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4b3922b3-319e-4010-a182-8fb4fd2637f3 tempest-ProjectMemberTests-1087249574 None] Created volume successfully. Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Creating offline snapshot 00ed6e37-a605-4ff3-83de-348bcff55112 of volume 488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad60b243-164b-4c4a-a1cc-6c15d26dab7a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:35 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e Nov 02 09:59:35 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:35 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e" returned: 0 in 0.402s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:35 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:35 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 1G Nov 02 09:59:35 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:36 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 1G" returned: 0 in 0.434s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488f0874-0183-4e84-80a0-4c3aa753f39e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:36 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488f0874-0183-4e84-80a0-4c3aa753f39e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 Nov 02 09:59:36 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:36 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488f0874-0183-4e84-80a0-4c3aa753f39e -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112" returned: 0 in 0.335s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:36 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 is being set with open permissions: ugo+rw Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:36 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 Nov 02 09:59:36 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:36 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112" returned: 0 in 0.298s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:36 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info Nov 02 09:59:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:37 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info" returned: 0 in 0.303s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:37 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info is being set with open permissions: ugo+rw Nov 02 09:59:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:37 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info Nov 02 09:59:37 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:37 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.info" returned: 0 in 0.272s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f063e6c7-c6d5-4314-bfe7-57f28b67fa6b tempest-ProjectMemberTests-1087249574 None] Create snapshot completed successfully Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-00ed6e37-a605-4ff3-83de-348bcff55112-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-00ed6e37-a605-4ff3-83de-348bcff55112-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-00ed6e37-a605-4ff3-83de-348bcff55112" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-00ed6e37-a605-4ff3-83de-348bcff55112" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Deleting offline snapshot 00ed6e37-a605-4ff3-83de-348bcff55112 of volume 488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] snapshot_file for this snap is: volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[e342770a-fa53-40dd-aeaf-d20445043823]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:38 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 Nov 02 09:59:38 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:38 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112" returned: 0 in 0.404s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488f0874-0183-4e84-80a0-4c3aa753f39e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e27e53-8e79-44df-9dae-b03e46853f78]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:39 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e Nov 02 09:59:39 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:39 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e" returned: 0 in 0.361s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:39 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 Nov 02 09:59:39 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:39 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112" returned: 0 in 0.364s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:39 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112 Nov 02 09:59:39 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:39 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e.00ed6e37-a605-4ff3-83de-348bcff55112" returned: 0 in 0.261s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-00ed6e37-a605-4ff3-83de-348bcff55112" released by "_delete_snapshot" :: held 1.505s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" released by "delete_snapshot" :: held 1.531s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Created reservations ['08246f2d-1555-4503-9df3-958345ec5c27', 'd7e80126-1bd8-43b2-a166-e04ad71628a9', '03570af7-93da-4857-9cd3-04bacd9768f1', '672211af-2891-403b-bba2-dce81e7c3c1e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Delete snapshot completed successfully. Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9fc76704-9b4e-472f-a4d4-1fd1db842a12 tempest-ProjectMemberTests-1087249574 None] Lock "cinder-00ed6e37-a605-4ff3-83de-348bcff55112-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-488f0874-0183-4e84-80a0-4c3aa753f39e-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "cinder-488f0874-0183-4e84-80a0-4c3aa753f39e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Acquiring lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d59b73a-a964-4875-a035-e4e9aff6631a]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:40 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e Nov 02 09:59:40 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:41 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e Nov 02 09:59:41 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-488f0874-0183-4e84-80a0-4c3aa753f39e" returned: 0 in 0.263s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "cinder-quobyte-488f0874-0183-4e84-80a0-4c3aa753f39e" released by "delete_volume" :: held 0.730s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Created reservations ['306dff13-c0af-4ae9-a3bb-028239e0a367', '9194cd93-eabb-4ef4-8833-77c81f44e48c', 'f907c6d3-eb9a-4859-a3f4-1b24465853d3', '7311d9a9-efc3-4c49-ba67-a677723b1785'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:41 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:41 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:41 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.262s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:41 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Deleted volume successfully. Nov 02 09:59:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-e340f894-f290-4452-8683-6c1b247765fe tempest-ProjectMemberTests-1087249574 None] Lock "cinder-488f0874-0183-4e84-80a0-4c3aa753f39e-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (f768f172-8470-44dd-bc39-876cb53e7f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2bd8e6-2229-426d-8e57-d5159999f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2bd8e6-2229-426d-8e57-d5159999f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743204886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979ae084-4b1b-4f64-9ebe-ac458d17b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:46Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d364b7ca-5a51-4e75-a30a-944904e4ed20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d364b7ca-5a51-4e75-a30a-944904e4ed20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f5c72c-8a82-4652-80d6-0df2093114a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f5c72c-8a82-4652-80d6-0df2093114a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979ae084-4b1b-4f64-9ebe-ac458d17b9d1', 'volume_name': 'volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faccf56b-ad6b-4f9b-ac12-de0b4bc3cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faccf56b-ad6b-4f9b-ac12-de0b4bc3cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de147643-a709-4692-825f-d10e29607b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:45 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Volume 979ae084-4b1b-4f64-9ebe-ac458d17b9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1', 'volume_size': 1} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743204886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979ae084-4b1b-4f64-9ebe-ac458d17b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:46Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Creating volume 979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:45 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:45 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:45 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 1073741824 Nov 02 09:59:45 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:46 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 1073741824" returned: 0 in 0.439s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:46 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 Nov 02 09:59:46 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:46 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" returned: 0 in 0.261s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de147643-a709-4692-825f-d10e29607b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a89a0c-e586-4066-a3f0-cd3e8987f84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:46 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Volume volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 (979ae084-4b1b-4f64-9ebe-ac458d17b9d1): created successfully Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a89a0c-e586-4066-a3f0-cd3e8987f84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:46 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (f768f172-8470-44dd-bc39-876cb53e7f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:46 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9f2f1582-bead-4c3d-b4db-ece443bb3c39 tempest-ProjectReaderTests-808409088 None] Created volume successfully. Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Creating offline snapshot a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 of volume 979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b4dfe8-52ba-47c4-ac24-cd0049c782f8]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:47 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 Nov 02 09:59:47 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:47 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" returned: 0 in 0.396s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:47 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 1G Nov 02 09:59:47 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:47 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 1G" returned: 0 in 0.426s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:47 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:47 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 Nov 02 09:59:47 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:48 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" returned: 0 in 0.323s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:48 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 is being set with open permissions: ugo+rw Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:48 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 Nov 02 09:59:48 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:48 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" returned: 0 in 0.253s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:48 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info Nov 02 09:59:48 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:48 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info" returned: 0 in 0.259s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:48 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info is being set with open permissions: ugo+rw Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:48 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info Nov 02 09:59:48 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:48 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:48 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.info" returned: 0 in 0.256s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:49 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:49 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-afeb5143-d121-47bf-9f11-69417273118a tempest-ProjectReaderTests-808409088 None] Create snapshot completed successfully Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Deleting offline snapshot a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 of volume 979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] snapshot_file for this snap is: volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2e4079-4570-45c2-b3cc-699276138c12]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:50 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 Nov 02 09:59:50 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:50 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" returned: 0 in 0.409s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[311edf69-85d6-4761-8031-18b998ac665c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:50 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:50 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 Nov 02 09:59:50 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:51 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" returned: 0 in 0.489s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:51 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 Nov 02 09:59:51 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:51 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" returned: 0 in 0.381s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:51 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9 Nov 02 09:59:51 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:51 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:51 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1.a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" returned: 0 in 0.256s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9" released by "_delete_snapshot" :: held 1.666s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" released by "delete_snapshot" :: held 1.690s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Created reservations ['39fee5c8-965d-4335-8c43-5e42a69f47a6', '5231ed21-4648-4216-ab17-27c92f748bce', '8ad082bd-1155-4008-9f22-cbcc13ea9320', '520b5861-e87b-4649-abc0-5742a4ada35e'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:52 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Delete snapshot completed successfully. Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-74a4acdd-c8f2-475f-b4da-f6f96d43a216 tempest-ProjectReaderTests-808409088 None] Lock "cinder-a3aeb4c3-dbbc-456e-9b4b-daa01beef2f9-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-979ae084-4b1b-4f64-9ebe-ac458d17b9d1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "cinder-979ae084-4b1b-4f64-9ebe-ac458d17b9d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" acquired by "delete_volume" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5cc7fc-2a3e-47c1-87e0-f69013f56d29]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:52 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 Nov 02 09:59:52 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:52 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:52 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:53 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1 Nov 02 09:59:53 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:53 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" returned: 0 in 0.282s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-979ae084-4b1b-4f64-9ebe-ac458d17b9d1" released by "delete_volume" :: held 0.759s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Created reservations ['3e922f16-3cae-4116-b897-22f8f37a497e', '23178206-7d5f-432c-9fa7-a7eabd26f389', '401f13a5-8067-4d5f-963c-fcc2b5854bd6', 'a45419e1-2b79-4509-96c2-b79e43362223'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:53 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:53 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:53 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.299s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:53 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Deleted volume successfully. Nov 02 09:59:53 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-ca6a11ff-4d30-4c1b-8fb6-f89a913a0368 tempest-ProjectReaderTests-808409088 None] Lock "cinder-979ae084-4b1b-4f64-9ebe-ac458d17b9d1-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (48a7b2e1-5e19-464e-8605-2f3804e08e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4209fdf-4f1b-4338-b35f-c29c9cbac62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4209fdf-4f1b-4338-b35f-c29c9cbac62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99574239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfa8561-cba7-453f-8641-aabd7eae8ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:54Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a73951b-f098-4d2c-90da-1902337a8c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a73951b-f098-4d2c-90da-1902337a8c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2ec4a8-3668-45ef-be21-23cb12e7c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2ec4a8-3668-45ef-be21-23cb12e7c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfa8561-cba7-453f-8641-aabd7eae8ae9', 'volume_name': 'volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa2c57-37e2-4e62-a3e4-4dec318cd2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa2c57-37e2-4e62-a3e4-4dec318cd2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169301f9-10c4-4e0f-a3b5-6efabb82ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Volume 0dfa8561-cba7-453f-8641-aabd7eae8ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9', 'volume_size': 1} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T08:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-99574239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfa8561-cba7-453f-8641-aabd7eae8ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T08:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T08:59:54Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Creating volume 0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 09:59:54 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:54 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 1073741824 Nov 02 09:59:54 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:54 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 1073741824" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:54 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 Nov 02 09:59:54 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:54 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9" returned: 0 in 0.251s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169301f9-10c4-4e0f-a3b5-6efabb82ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52b8df-0fdc-47e5-9352-162a7d30183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 09:59:54 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Volume volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 (0dfa8561-cba7-453f-8641-aabd7eae8ae9): created successfully Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52b8df-0fdc-47e5-9352-162a7d30183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 09:59:54 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (48a7b2e1-5e19-464e-8605-2f3804e08e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 09:59:54 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-e97f01ce-8011-47db-9279-c754ae9bb7b5 tempest-ProjectReaderTests-808409088 None] Created volume successfully. Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Creating offline snapshot 8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 of volume 0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cc7d4-f688-4bd4-8e1b-6e722f8684ca]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:55 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 Nov 02 09:59:55 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:55 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9" returned: 0 in 0.375s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:55 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:55 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 1G Nov 02 09:59:55 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:56 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 1G" returned: 0 in 0.418s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:56 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 Nov 02 09:59:56 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:56 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" returned: 0 in 0.293s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:56 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 is being set with open permissions: ugo+rw Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:56 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 Nov 02 09:59:56 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:56 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" returned: 0 in 0.258s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:56 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info Nov 02 09:59:56 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:56 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:56 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info is being set with open permissions: ugo+rw Nov 02 09:59:56 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:57 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info Nov 02 09:59:57 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:57 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.info" returned: 0 in 0.272s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:57 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a4f24dde-b131-4654-a854-d704ba7f54e7 tempest-ProjectReaderTests-808409088 None] Create snapshot completed successfully Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Deleting offline snapshot 8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 of volume 0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] snapshot_file for this snap is: volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7da537-dcd2-4f92-89c8-eac16931682e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:57 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 Nov 02 09:59:57 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:57 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" returned: 0 in 0.401s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f39dbc-9c0e-4057-963c-6ee00b34c0c0]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:57 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 Nov 02 09:59:58 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 09:59:58 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:58 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9" returned: 0 in 0.404s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 Nov 02 09:59:58 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:58 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.328s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 09:59:58 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" returned: 0 in 0.412s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:58 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2 Nov 02 09:59:58 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 09:59:59 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9.8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" returned: 0 in 0.273s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2" released by "_delete_snapshot" :: held 1.604s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" released by "delete_snapshot" :: held 1.632s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Created reservations ['fd0f4c79-22ed-4557-ad5e-0f7d90597fc6', 'b1a08938-d61a-4806-8f9b-5b6112b5ae4f', 'f1d206be-74ba-4ae5-9aba-40f7a11fb7c2', 'b6c9bd78-b4ce-4696-82db-65a1f092b8b6'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 09:59:59 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Delete snapshot completed successfully. Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-39253b3d-31ee-4caa-96d1-7bfba8ebc36c tempest-ProjectReaderTests-808409088 None] Lock "cinder-8f9b5514-75f8-44f9-afa7-ea1bb2cef0f2-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-0dfa8561-cba7-453f-8641-aabd7eae8ae9-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "cinder-0dfa8561-cba7-453f-8641-aabd7eae8ae9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad0ae6d-784a-4f7e-a212-7d282a0169b3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 09:59:59 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 09:59:59 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 Nov 02 09:59:59 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:00 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9" returned: 0 in 0.371s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:00 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9 Nov 02 10:00:00 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:00 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-0dfa8561-cba7-453f-8641-aabd7eae8ae9" returned: 0 in 0.269s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-0dfa8561-cba7-453f-8641-aabd7eae8ae9" released by "delete_volume" :: held 0.717s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Created reservations ['712bc0d5-2860-4aca-b538-131d12d8f1d0', '1ded0c02-0fea-4295-83a9-b40cfae2154f', '43021c43-4f24-4c7c-abb9-783439f1fbee', '28c627f8-047a-47d4-8b81-fa3c13cec746'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:00 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:00 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:00 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.260s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:00 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Deleted volume successfully. Nov 02 10:00:00 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-1200cca0-41d7-4546-b8fc-e67df6d3655a tempest-ProjectReaderTests-808409088 None] Lock "cinder-0dfa8561-cba7-453f-8641-aabd7eae8ae9-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (925dccfe-9c97-4d30-9002-017046b30dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b014a0-0f99-46bd-9d80-8d1abadab231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48b014a0-0f99-46bd-9d80-8d1abadab231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603903943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abd329f-990f-4cbc-929e-ee0cd0bb9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:01Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae63530-2408-4522-af82-f316c5b517e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae63530-2408-4522-af82-f316c5b517e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2389f941-ad66-4a6b-8fa5-8b385eefbf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2389f941-ad66-4a6b-8fa5-8b385eefbf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3abd329f-990f-4cbc-929e-ee0cd0bb9146', 'volume_name': 'volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96be8fe-6031-465a-9842-4db439a8df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96be8fe-6031-465a-9842-4db439a8df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af398dbc-2185-403f-a216-a5c8cdc1da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:01 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Volume 3abd329f-990f-4cbc-929e-ee0cd0bb9146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146', 'volume_size': 1} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1603903943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3abd329f-990f-4cbc-929e-ee0cd0bb9146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:01Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Creating volume 3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:01 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:01 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 1073741824 Nov 02 10:00:01 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:01 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:01 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 1073741824" returned: 0 in 0.539s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:02 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 Nov 02 10:00:02 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:02 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146" returned: 0 in 0.260s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af398dbc-2185-403f-a216-a5c8cdc1da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a585cbc1-6be1-479c-9b0d-87cc6c003310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:02 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Volume volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 (3abd329f-990f-4cbc-929e-ee0cd0bb9146): created successfully Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a585cbc1-6be1-479c-9b0d-87cc6c003310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:02 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (925dccfe-9c97-4d30-9002-017046b30dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:02 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-7af4a8de-54ae-404f-af2b-306efbbe02e8 tempest-ProjectReaderTests-808409088 None] Created volume successfully. Nov 02 10:00:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:03 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Creating offline snapshot d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 of volume 3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:00:03 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f1f6ed-63af-422d-94d5-3aa7b696f6f4]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:03 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:03 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 Nov 02 10:00:03 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:04 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146" returned: 0 in 0.422s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 1G Nov 02 10:00:04 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:04 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 1G" returned: 0 in 0.443s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 Nov 02 10:00:04 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:04 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" returned: 0 in 0.306s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:04 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 is being set with open permissions: ugo+rw Nov 02 10:00:04 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:04 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 Nov 02 10:00:04 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" returned: 0 in 0.255s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info Nov 02 10:00:05 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info" returned: 0 in 0.261s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info is being set with open permissions: ugo+rw Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:05 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info Nov 02 10:00:05 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:05 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.info" returned: 0 in 0.254s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:05 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:05 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-63ed9304-a33e-43e0-a59a-c06aea1838e9 tempest-ProjectReaderTests-808409088 None] Create snapshot completed successfully Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Deleting offline snapshot d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 of volume 3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] snapshot_file for this snap is: volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[296ef4f3-470c-4188-ab2f-be3d9db1efc3]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:06 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:07 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 Nov 02 10:00:07 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:07 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" returned: 0 in 0.389s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a23d75-6970-45ff-afda-ecb99800a0be]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:07 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 Nov 02 10:00:07 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:07 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146" returned: 0 in 0.396s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:07 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:07 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 Nov 02 10:00:07 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:08 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" returned: 0 in 0.377s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:08 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4 Nov 02 10:00:08 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:08 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146.d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" returned: 0 in 0.289s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4" released by "_delete_snapshot" :: held 1.567s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" released by "delete_snapshot" :: held 1.593s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Created reservations ['a359fc75-481c-4215-b375-eb75c5ff8497', '9d88fe11-3573-45dc-8ef1-8c5776e21d98', '4f56e985-74af-4847-8ad2-4d5a1f9ac51a', 'e07334f2-ef26-40fb-b584-e7b681648946'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:08 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Delete snapshot completed successfully. Nov 02 10:00:08 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a2fdef66-8fea-4ef1-b2af-b46bb3044a66 tempest-ProjectReaderTests-808409088 None] Lock "cinder-d6e6df1b-d2c9-44bc-b33c-54e641b3c2c4-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-3abd329f-990f-4cbc-929e-ee0cd0bb9146-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "cinder-3abd329f-990f-4cbc-929e-ee0cd0bb9146-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" acquired by "delete_volume" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[0266792b-d8f8-4450-a271-3b81744f5a40]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:09 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 Nov 02 10:00:09 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:09 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146" returned: 0 in 0.395s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:09 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146 Nov 02 10:00:09 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:09 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3abd329f-990f-4cbc-929e-ee0cd0bb9146" returned: 0 in 0.291s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-3abd329f-990f-4cbc-929e-ee0cd0bb9146" released by "delete_volume" :: held 0.761s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:09 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Created reservations ['f88b309e-8377-4e50-8d2e-d932918ae53f', '5c0c776e-ba03-42ca-a402-1c15f5215deb', '28d43c90-e13d-44c2-8d60-b492171c8b0b', '9751f273-623d-469f-914d-8026bcbe721f'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:10 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:10 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:10 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.279s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:10 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Deleted volume successfully. Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=99,cinder:INSERT=40,cinder:UPDATE=136,cinder:DELETE=9 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-9d7a3351-9ac4-4cc6-96e9-e308184f3c6c tempest-ProjectReaderTests-808409088 None] Lock "cinder-3abd329f-990f-4cbc-929e-ee0cd0bb9146-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=122,cinder:SELECT=95,cinder:DELETE=11,cinder:INSERT=32 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (0fbcaa58-65ba-43d5-947d-1d755f90ab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68cfa5-e6b6-4c8e-917e-47661e02391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68cfa5-e6b6-4c8e-917e-47661e02391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979244877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:11Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8098f882-7e29-4f4d-ab58-809f3019addb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8098f882-7e29-4f4d-ab58-809f3019addb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8442fb7c-39d9-4db6-9c87-b1c2da834a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8442fb7c-39d9-4db6-9c87-b1c2da834a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7', 'volume_name': 'volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4434bbed-8023-466f-8f0b-8bfcb7d37323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4434bbed-8023-466f-8f0b-8bfcb7d37323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b917b8-8b2e-48fd-8401-6b8fe0e93d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:10 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Volume 1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7', 'volume_size': 1} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979244877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:11Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Creating volume 1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:10 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 10:00:10 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:10 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 1073741824 Nov 02 10:00:10 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:11 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 1073741824" returned: 0 in 0.439s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:11 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 Nov 02 10:00:11 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:11 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" returned: 0 in 0.263s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b917b8-8b2e-48fd-8401-6b8fe0e93d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366cde10-1ebf-49db-840e-e4cc5750aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:11 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Volume volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 (1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7): created successfully Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366cde10-1ebf-49db-840e-e4cc5750aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (0fbcaa58-65ba-43d5-947d-1d755f90ab21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:11 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-861ee889-f3f7-4212-bb00-d8719e4b8033 tempest-ProjectReaderTests-808409088 None] Created volume successfully. Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Creating offline snapshot 8fb4e84c-765e-4cba-8582-e9e2b104003b of volume 1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:00:11 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[57633a24-9cd2-4e3e-898e-5e4272062c1d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:12 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 Nov 02 10:00:12 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:12 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" returned: 0 in 0.375s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:12 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b 1G Nov 02 10:00:12 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:12 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b 1G" returned: 0 in 0.433s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:12 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:12 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b Nov 02 10:00:12 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b" returned: 0 in 0.315s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b is being set with open permissions: ugo+rw Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b Nov 02 10:00:13 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b" returned: 0 in 0.243s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info Nov 02 10:00:13 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info" returned: 0 in 0.243s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info is being set with open permissions: ugo+rw Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:13 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info Nov 02 10:00:13 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:13 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.info" returned: 0 in 0.250s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:13 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:13 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-4c27f04b-92b9-48e6-a8af-f6532cbcd057 tempest-ProjectReaderTests-808409088 None] Create snapshot completed successfully Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-8fb4e84c-765e-4cba-8582-e9e2b104003b-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-8fb4e84c-765e-4cba-8582-e9e2b104003b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-8fb4e84c-765e-4cba-8582-e9e2b104003b" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8fb4e84c-765e-4cba-8582-e9e2b104003b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Deleting offline snapshot 8fb4e84c-765e-4cba-8582-e9e2b104003b of volume 1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] snapshot_file for this snap is: volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c7542d-1847-4254-a1ca-b01cd495d30d]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:14 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b Nov 02 10:00:14 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:14 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b" returned: 0 in 0.358s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a46df-dd7b-43ea-acc5-a2f17bb0d29e]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:14 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 Nov 02 10:00:14 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:14 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" returned: 0 in 0.364s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:14 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:14 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b Nov 02 10:00:14 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:15 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b" returned: 0 in 0.347s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:15 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b Nov 02 10:00:15 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:15 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7.8fb4e84c-765e-4cba-8582-e9e2b104003b" returned: 0 in 0.253s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8fb4e84c-765e-4cba-8582-e9e2b104003b" released by "_delete_snapshot" :: held 1.426s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" released by "delete_snapshot" :: held 1.451s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Created reservations ['c333fb55-9cdf-4e70-9a9f-b1ab03d34533', '30d65df5-c2ef-436d-96dc-d0c2286cf3c4', '42da4fbb-a293-4083-ace1-834ab54bcb28', 'bf712daa-0be3-48d0-8772-ce6b5b7863d2'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:15 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Delete snapshot completed successfully. Nov 02 10:00:15 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a74a6acb-7ff9-462a-b6ea-78cd4f9628b4 tempest-ProjectReaderTests-808409088 None] Lock "cinder-8fb4e84c-765e-4cba-8582-e9e2b104003b-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "cinder-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14ca5f-a923-40b1-b60f-fa41382c05e1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:16 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 Nov 02 10:00:16 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:16 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" returned: 0 in 0.394s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:16 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:16 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7 Nov 02 10:00:16 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:17 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" returned: 0 in 0.251s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7" released by "delete_volume" :: held 0.721s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Created reservations ['86a5a81b-0ab3-4a97-84c2-bc58878d65d8', '19771d4f-be83-4531-90a4-85e9c49d1807', 'f9ad063e-f7c0-47c5-a820-8f6b4b934764', '8977348c-89e9-4265-805d-193a2311539a'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:17 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:17 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:17 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.307s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:17 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Deleted volume successfully. Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-a54dfe8c-e0e2-4fe6-b15c-2e46ddeb90c8 tempest-ProjectReaderTests-808409088 None] Lock "cinder-1eb7f790-07fd-4dd3-a8a8-f9ea8a3c27f7-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (8936f2c5-3a1f-4b46-b202-74457db1fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468cffb7-3ee8-40a5-b3c1-d55b1453599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468cffb7-3ee8-40a5-b3c1-d55b1453599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700708432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8142c705-4b2c-4c7b-926e-0e814eeab211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:18Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ecef77-99aa-41bf-ae0c-286fe3a9245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ecef77-99aa-41bf-ae0c-286fe3a9245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07a331-30cf-45b7-a9e9-d66a51102dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07a331-30cf-45b7-a9e9-d66a51102dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8142c705-4b2c-4c7b-926e-0e814eeab211', 'volume_name': 'volume-8142c705-4b2c-4c7b-926e-0e814eeab211', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921b7388-e65e-4f1c-a2c4-c877f75996f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:17 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921b7388-e65e-4f1c-a2c4-c877f75996f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae8ed47-1904-4a62-96af-b5b076900447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Volume 8142c705-4b2c-4c7b-926e-0e814eeab211: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8142c705-4b2c-4c7b-926e-0e814eeab211', 'volume_size': 1} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700708432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8142c705-4b2c-4c7b-926e-0e814eeab211,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81b633cd70154547be9c2d72138c2da5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:18Z,use_quota=True,user_id='f8d5e614579743a8a8125f1b199a37bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Creating volume 8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:18 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:18 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 1073741824 Nov 02 10:00:18 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:18 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 1073741824" returned: 0 in 0.436s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:18 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 Nov 02 10:00:18 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:18 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211" returned: 0 in 0.258s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae8ed47-1904-4a62-96af-b5b076900447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8142c705-4b2c-4c7b-926e-0e814eeab211', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a3baa-0228-478c-9b0f-c5fcb991e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:18 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Volume volume-8142c705-4b2c-4c7b-926e-0e814eeab211 (8142c705-4b2c-4c7b-926e-0e814eeab211): created successfully Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089a3baa-0228-478c-9b0f-c5fcb991e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:18 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Flow 'volume_create_manager' (8936f2c5-3a1f-4b46-b202-74457db1fe29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:18 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-df5c25c5-587d-46cb-94a8-f79621e71fbd tempest-ProjectReaderTests-808409088 None] Created volume successfully. Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Creating offline snapshot dc073e10-c717-4ba9-829a-931e8d2da742 of volume 8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[9502915a-7eef-411f-9b9b-0ae726bf7ada]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 Nov 02 10:00:19 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:19 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211" returned: 0 in 0.390s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 1G {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 1G Nov 02 10:00:19 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:19 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 1G" returned: 0 in 0.400s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:19 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8142c705-4b2c-4c7b-926e-0e814eeab211 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:19 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8142c705-4b2c-4c7b-926e-0e814eeab211 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 Nov 02 10:00:19 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:20 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8142c705-4b2c-4c7b-926e-0e814eeab211 -F qcow2 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742" returned: 0 in 0.324s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 is being set with open permissions: ugo+rw Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:20 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 Nov 02 10:00:20 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:20 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742" returned: 0 in 0.270s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:20 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info Nov 02 10:00:20 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:20 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info" returned: 0 in 0.278s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:20 devstack cinder-volume[86887]: WARNING cinder.volume.drivers.remotefs [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info is being set with open permissions: ugo+rw Nov 02 10:00:20 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:20 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info Nov 02 10:00:20 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:21 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.info" returned: 0 in 0.284s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:21 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:21 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-631ff1a9-3708-4955-a53a-9644106017f6 tempest-ProjectReaderTests-808409088 None] Create snapshot completed successfully Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-dc073e10-c717-4ba9-829a-931e8d2da742-delete_snapshot" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-dc073e10-c717-4ba9-829a-931e8d2da742-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" by "delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-dc073e10-c717-4ba9-829a-931e8d2da742" by "_delete_snapshot" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-dc073e10-c717-4ba9-829a-931e8d2da742" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Deleting offline snapshot dc073e10-c717-4ba9-829a-931e8d2da742 of volume 8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] snapshot_file for this snap is: volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25238ca-f48f-4eef-8f1b-dd8f7e1d4cac]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:22 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 Nov 02 10:00:22 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:22 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742" returned: 0 in 0.387s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8142c705-4b2c-4c7b-926e-0e814eeab211(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86887) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bab263f-848e-48b5-92d0-b0ecf982319c]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:22 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:22 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 Nov 02 10:00:22 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:23 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211" returned: 0 in 0.366s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:23 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 Nov 02 10:00:23 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:23 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742" returned: 0 in 0.349s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:23 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742 Nov 02 10:00:23 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:23 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211.dc073e10-c717-4ba9-829a-931e8d2da742" returned: 0 in 0.262s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-dc073e10-c717-4ba9-829a-931e8d2da742" released by "_delete_snapshot" :: held 1.471s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" released by "delete_snapshot" :: held 1.493s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Created reservations ['8adf5dcd-1ac5-4463-8f66-256b0f5933a8', '3db72065-76a0-4b4f-a048-ee4605bac677', '30c799bb-c988-4890-b984-7ec29639a3ca', '2b7445b6-4879-42b3-8f29-e261e3891d59'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:23 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Delete snapshot completed successfully. Nov 02 10:00:23 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-f4cf8cca-529a-40cc-8c96-ee285c9476f0 tempest-ProjectReaderTests-808409088 None] Lock "cinder-dc073e10-c717-4ba9-829a-931e8d2da742-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-8142c705-4b2c-4c7b-926e-0e814eeab211-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "cinder-8142c705-4b2c-4c7b-926e-0e814eeab211-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Acquiring lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa10ce76-9643-455b-8257-53d26b8032d1]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:24 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 Nov 02 10:00:24 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:24 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211" returned: 0 in 0.416s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:24 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:25 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211 Nov 02 10:00:25 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:25 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-8142c705-4b2c-4c7b-926e-0e814eeab211" returned: 0 in 0.279s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "cinder-quobyte-8142c705-4b2c-4c7b-926e-0e814eeab211" released by "delete_volume" :: held 0.765s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Created reservations ['2a91ca25-d746-42be-95af-1f940a45e24c', 'e83819ab-529a-453f-aad6-3af44d45fcd5', '95714180-7abd-4113-bff9-40654393c1e0', '38243f73-f9c2-45d9-8ebd-3cffd34efe8b'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:25 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:25 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:25 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.295s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:25 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Deleted volume successfully. Nov 02 10:00:25 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-be0dcace-d597-4569-831d-622d83e9d8d3 tempest-ProjectReaderTests-808409088 None] Lock "cinder-8142c705-4b2c-4c7b-926e-0e814eeab211-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=25,cinder:INSERT=10,cinder:UPDATE=32 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:35 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=40,cinder:SELECT=30,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Flow 'volume_create_manager' (809dbb7b-78f8-4105-b29a-433a65912a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73034eb-3069-4796-b403-821162832a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73034eb-3069-4796-b403-821162832a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086774268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e441050-4217-4ed2-8380-0e305b41e689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddc9f429f724c1d90bdfd028462da15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:36Z,use_quota=True,user_id='fbcd10c09f8a4e4aa1bb5862f0b71238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127420b8-e301-4981-9496-dd7ad35ad144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127420b8-e301-4981-9496-dd7ad35ad144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f42e7b4-bea1-459c-8347-354503b9d986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f42e7b4-bea1-459c-8347-354503b9d986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e441050-4217-4ed2-8380-0e305b41e689', 'volume_name': 'volume-3e441050-4217-4ed2-8380-0e305b41e689', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfeaf9fe-cd0e-49e9-8cf0-ad64e584695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfeaf9fe-cd0e-49e9-8cf0-ad64e584695a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455a7815-743b-4879-94b8-e4d81f32fa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:36 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Volume 3e441050-4217-4ed2-8380-0e305b41e689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e441050-4217-4ed2-8380-0e305b41e689', 'volume_size': 1} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2086774268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e441050-4217-4ed2-8380-0e305b41e689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddc9f429f724c1d90bdfd028462da15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:36Z,use_quota=True,user_id='fbcd10c09f8a4e4aa1bb5862f0b71238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Creating volume 3e441050-4217-4ed2-8380-0e305b41e689 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:36 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:36 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 1073741824 Nov 02 10:00:36 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:36 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 1073741824" returned: 0 in 0.457s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:36 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:36 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 Nov 02 10:00:36 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:37 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689" returned: 0 in 0.259s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455a7815-743b-4879-94b8-e4d81f32fa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e441050-4217-4ed2-8380-0e305b41e689', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5667e4-3dea-4345-bb21-61f5e5e6efed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:37 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Volume volume-3e441050-4217-4ed2-8380-0e305b41e689 (3e441050-4217-4ed2-8380-0e305b41e689): created successfully Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5667e4-3dea-4345-bb21-61f5e5e6efed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Flow 'volume_create_manager' (809dbb7b-78f8-4105-b29a-433a65912a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:37 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-ca088afb-f3d8-48e9-b7f5-c8ee2920cadd tempest-ProjectReaderTests-1004045469 None] Created volume successfully. Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "cinder-3e441050-4217-4ed2-8380-0e305b41e689-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-3e441050-4217-4ed2-8380-0e305b41e689-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "cinder-quobyte-3e441050-4217-4ed2-8380-0e305b41e689" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-quobyte-3e441050-4217-4ed2-8380-0e305b41e689" acquired by "delete_volume" :: waited 0.016s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e22cccd-9e01-4b5f-b1f6-2cee5ee5719b]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:37 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 Nov 02 10:00:37 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:37 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689" returned: 0 in 0.355s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:37 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:37 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689 Nov 02 10:00:37 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:38 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-3e441050-4217-4ed2-8380-0e305b41e689" returned: 0 in 0.237s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-quobyte-3e441050-4217-4ed2-8380-0e305b41e689" released by "delete_volume" :: held 0.638s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Created reservations ['87663468-4d01-44b6-9c25-199e9c6c9d98', '33973bff-c4ea-49d5-9b22-fe4fbf0b5d9c', '9a1c381b-d4d2-4182-90d0-625b964af879', '282f8b9e-a012-48f8-8ff6-0d09d041f112'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:38 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:38 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:38 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.266s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:38 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Deleted volume successfully. Nov 02 10:00:38 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-bfe7aca1-72c0-4b02-9010-5403a3b93ce0 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-3e441050-4217-4ed2-8380-0e305b41e689-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86887) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Flow 'volume_create_manager' (5ba7ad9a-0c83-497a-bb29-ee86979ed93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c06ce79-70cf-4dd3-963c-77b8fd1e247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c06ce79-70cf-4dd3-963c-77b8fd1e247b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199815370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1643aa-f155-466b-9827-4d538de6e0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddc9f429f724c1d90bdfd028462da15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:39Z,use_quota=True,user_id='fbcd10c09f8a4e4aa1bb5862f0b71238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1446472c-2f29-465a-b9c3-a187cfa76f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1446472c-2f29-465a-b9c3-a187cfa76f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872caa6f-6fd5-428c-a81c-fe2defb1df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872caa6f-6fd5-428c-a81c-fe2defb1df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1643aa-f155-466b-9827-4d538de6e0a1', 'volume_name': 'volume-fe1643aa-f155-466b-9827-4d538de6e0a1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01782a7-b42f-426d-b905-a0706a1aac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01782a7-b42f-426d-b905-a0706a1aac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e38451-6666-421b-8cda-35286063b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:39 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Volume fe1643aa-f155-466b-9827-4d538de6e0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1643aa-f155-466b-9827-4d538de6e0a1', 'volume_size': 1} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T09:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-199815370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1643aa-f155-466b-9827-4d538de6e0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddc9f429f724c1d90bdfd028462da15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T09:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T09:00:39Z,use_quota=True,user_id='fbcd10c09f8a4e4aa1bb5862f0b71238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(062036ec-0413-46d1-9252-f135c6dd73ed),volume_type_id=062036ec-0413-46d1-9252-f135c6dd73ed)}" {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.remotefs [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Creating volume fe1643aa-f155-466b-9827-4d538de6e0a1 {{(pid=86887) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Selected osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 as target Quobyte volume. {{(pid=86887) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 10:00:39 devstack cinder-volume[86887]: INFO cinder.volume.drivers.remotefs [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] casted to osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5 Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 1073741824 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:39 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 1073741824 Nov 02 10:00:39 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:39 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 1073741824" returned: 0 in 0.521s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:39 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:39 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 Nov 02 10:00:39 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:40 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1" returned: 0 in 0.341s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'} {{(pid=86887) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e38451-6666-421b-8cda-35286063b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1643aa-f155-466b-9827-4d538de6e0a1', 'volume_size': 1}' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f89682-9874-4d74-9e3b-6a2cf45f35f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 10:00:40 devstack cinder-volume[86887]: INFO cinder.volume.flows.manager.create_volume [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Volume volume-fe1643aa-f155-466b-9827-4d538de6e0a1 (fe1643aa-f155-466b-9827-4d538de6e0a1): created successfully Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f89682-9874-4d74-9e3b-6a2cf45f35f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86887) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 10:00:40 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Flow 'volume_create_manager' (5ba7ad9a-0c83-497a-bb29-ee86979ed93c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86887) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 10:00:40 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-a47f5c6f-f502-40f3-962a-7909adcce51b tempest-ProjectReaderTests-1004045469 None] Created volume successfully. Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "cinder-fe1643aa-f155-466b-9827-4d538de6e0a1-delete_volume" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-fe1643aa-f155-466b-9827-4d538de6e0a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "cinder-quobyte-fe1643aa-f155-466b-9827-4d538de6e0a1" by "delete_volume" {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-quobyte-fe1643aa-f155-466b-9827-4d538de6e0a1" acquired by "delete_volume" :: waited 0.018s {{(pid=86887) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a81f30-877b-47e1-9a87-c15e22a32e50]: (4, 'qcow2') {{(pid=88036) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:41 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 Nov 02 10:00:41 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:41 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1" returned: 0 in 0.487s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:41 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:41 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1 Nov 02 10:00:41 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:42 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080/volume-fe1643aa-f155-466b-9827-4d538de6e0a1" returned: 0 in 0.392s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-quobyte-fe1643aa-f155-466b-9827-4d538de6e0a1" released by "delete_volume" :: held 0.928s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.quota [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Created reservations ['f10c1283-14c8-4e95-b10d-7fdb063a2a23', 'db937d4e-7a5c-4bcb-814b-6a66ee0ded7f', '310e91c1-3fac-49b0-95bb-bef117729e04', 'acb6b2c7-961f-4d05-ba9f-1727e818f978'] {{(pid=86887) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:42 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:42 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:42 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.329s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:42 devstack cinder-volume[86887]: INFO cinder.volume.manager [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Deleted volume successfully. Nov 02 10:00:42 devstack cinder-volume[86887]: DEBUG cinder.coordination [None req-c56a7ef2-6711-41cc-b7eb-5fadbb33d016 tempest-ProjectReaderTests-1004045469 None] Lock "cinder-fe1643aa-f155-466b-9827-4d538de6e0a1-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86887) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 10:00:55 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:UPDATE=22,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:55 devstack cinder-volume[86887]: DEBUG dbcounter [-] [86887] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86887) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5': None} {{(pid=86887) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG cinder.volume.drivers.quobyte [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a52c2c0-9869-4c5d-9a05-a7e3ecba9ba5'] {{(pid=86887) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.lockutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86887) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 10:00:58 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080 Nov 02 10:00:58 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 10:00:58 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_concurrency.processutils [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/061a75c73b0e12ae39230df2d8334080" returned: 0 in 0.318s {{(pid=86887) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG cinder.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Notifying Schedulers of capabilities ... {{(pid=86887) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG oslo_service.periodic_task [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86887) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread count: 29 {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 10:00:58 devstack cinder-volume[86887]: DEBUG cinder.volume.manager [None req-b43c7061-d6d4-4020-90a8-858c48d70fb3 None None] thread info: [<_MainThread(MainThread, started 132533568585856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86887) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}